trace: memory at time T — stack in the dock, live bytes in hex

M2. Trace.memory(addr, length, idx) reconstructs what memory held at a moment,
returning the bytes AND a per-byte "known" mask. The mask is the point: a trace
knows what it observed and nothing else, so a byte nobody read or wrote is
genuinely unknown and must not be drawn as zero. That distinction is the whole
reason to read memory from a trace instead of the database — the database has
the file's bytes, the trace has what was actually there.

Reads count as evidence, not just writes: an instruction reading a byte reveals
what it held then.

Indexed by ADDRESS (sorted once, bisect per query), because the question is
"what was in this window at time t" and the accesses that matter are the few
touching that window, not the tens of thousands in the trace.

Where the memory actually is: measured, 0% of accesses in either real trace fall
inside the image — every one is stack or heap. So the primary view is the STACK,
in the dock, anchored at SP:

  stack (rsp)
  ▸7ffff6f99470 ????????????????
   7ffff6f99478 00007ffff6fb0b00
   7ffff6f99488 00007ffff6fa94e5

The hex view overlays trace bytes on the file's contents (green = the trace saw
this byte at this timestamp, grey = still the file's idea). Correct, and it will
matter for a program that writes globals, but on these traces it shows nothing —
which is why the stack pane is the deliverable and not a nice-to-have.

One bug the work surfaced: MemOp.addr was having the image slide applied to it,
which is nonsense for a stack address — it produced -0xc838. The slide relocates
the IMAGE; stack and heap have no database counterpart. Memory op addresses now
stay in trace space, and memory_raw() queries there, while memory() takes
database addresses for the hex view.

tests: +9 model (35) covering the known-mask, reads-as-evidence, partial
coverage and the writers/accessors queries; +1 differential (12) checking
reconstructed memory state against Tenet's own get_memory at sampled timestamps;
+5 UI (30) for the stack pane — present, anchored at SP, marks unseen bytes,
follows time. 212/0 scenarios.

2 files changed, 196 insertions, 6 deletions

diff --git a/idatui/app.py b/idatui/app.py
index 9d99122..9661ebd 100644
--- a/idatui/app.py
+++ b/idatui/app.py
@@ -98,6 +98,11 @@ _S_CURSOR = Style(bgcolor="#2a313c")
 _S_TRAIL_NOW = Style(bgcolor="#3f3410")
 _S_TRAIL_PAST = Style(bgcolor="#2b1c17")     # warm: behind you
 _S_TRAIL_FUTURE = Style(bgcolor="#152230")   # cool: ahead of you
+#: Hex with a trace loaded: bytes the trace SAW at this timestamp vs bytes we're
+#: still showing from the file. The distinction matters more than the values —
+#: one is evidence, the other is an assumption.
+_S_HEX_LIVE = Style(color="#9ece6a")
+_S_HEX_STALE = Style(color="#5e6875")
 _S_DIM = Style(color="#7c8b9e", italic=True)
 _S_MATCH = Style(bgcolor="#7a5c00")  # all search matches
 _S_MATCH_CUR = Style(bgcolor="#d0a215", color="#12161c")  # the current match
@@ -1561,6 +1566,10 @@ class HexView(ScrollView, can_focus=True):
         super().__init__(id="hex")
         self.model = None
         self.total = 0
+        #: Trace to read memory from, and the timestamp to read it at. When set,
+        #: the dump shows what memory HELD then rather than what the file holds.
+        self.trace = None
+        self.trace_idx = 0
         self._internal_top: int | None = None  # scroll target we set ourselves
 
     # -- public API -------------------------------------------------------- #
@@ -1747,6 +1756,15 @@ class HexView(ScrollView, can_focus=True):
             return Strip([Segment("".ljust(width), _S_HEX)])
         va, data = model.row(r)
         cur_row, cur_col = self.cursor // 16, self.cursor % 16
+        # With a trace loaded the row shows what memory HELD at the current
+        # timestamp, not what the file contains. Only the bytes the trace
+        # actually saw are overlaid: the rest stay the database's, dimmed, so
+        # you can always tell evidence from the file's idea of the world.
+        tmem = tknown = None
+        if self.trace is not None and data is not None:
+            tmem, tknown = self.trace.memory(va, len(data), self.trace_idx)
+            if not any(tknown):
+                tmem = tknown = None
         fo = model.file_offset(va)
         fo_str = f"{fo:08X}" if fo is not None else "--------"
         segs: list[Segment] = [
@@ -1761,15 +1779,29 @@ class HexView(ScrollView, can_focus=True):
                 if i == 8:
                     segs.append(Segment(" ", _S_HEX))
                 if i < n:
-                    st = _S_CELL if (r == cur_row and i == cur_col) else _S_HEX
-                    segs.append(Segment(f"{data[i]:02X} ", st))
+                    live = tknown is not None and tknown[i]
+                    val = tmem[i] if live else data[i]
+                    if r == cur_row and i == cur_col:
+                        st = _S_CELL
+                    elif tknown is None:
+                        st = _S_HEX
+                    else:
+                        st = _S_HEX_LIVE if live else _S_HEX_STALE
+                    segs.append(Segment(f"{val:02X} ", st))
                 else:
                     segs.append(Segment("   ", _S_HEX))
             segs.append(Segment(" |", _S_DIM))
             for i in range(16):
                 if i < n:
-                    ch = chr(data[i]) if 32 <= data[i] < 127 else "."
-                    st = _S_CELL if (r == cur_row and i == cur_col) else _S_ASCII
+                    live = tknown is not None and tknown[i]
+                    val = tmem[i] if live else data[i]
+                    ch = chr(val) if 32 <= val < 127 else "."
+                    if r == cur_row and i == cur_col:
+                        st = _S_CELL
+                    elif tknown is None:
+                        st = _S_ASCII
+                    else:
+                        st = _S_HEX_LIVE if live else _S_HEX_STALE
                 else:
                     ch, st = " ", _S_ASCII
                 segs.append(Segment(ch, st))
@@ -2325,6 +2357,7 @@ class TraceDock(Vertical):
     def compose(self) -> ComposeResult:
         yield Static("", id="trace-head", markup=False)
         yield Static("", id="trace-regs", markup=False)
+        yield Static("", id="trace-stack", markup=False)
         yield TraceTimeline(id="trace-timeline")
 
     def show(self, trace, idx: int) -> None:
@@ -2367,11 +2400,49 @@ class TraceDock(Vertical):
             body.append(f"{v:#018x}\n" if v > 0xFFFFFFFF else f"{v:#010x}\n",
                         _S_DATA if hot else (_S_LABEL if name == pc else _S_INSN))
         self.query_one("#trace-regs", Static).update(body)
+        self._render_stack(t)
         tl = self.query_one(TraceTimeline)
         tl.idx = self.idx
         tl.refresh()
 
 
+    STACK_WORDS = 8
+
+    def _render_stack(self, t) -> None:  # type: ignore[no-untyped-def]
+        """The stack as of this instant, read out of the trace.
+
+        This is where a trace's memory actually is: on two real traces, NONE of
+        the accesses fell inside the image — every one was stack or heap. A
+        memory view that could only address the image would have nothing to show.
+
+        Bytes the trace never saw are printed as '??' rather than zeros. A trace
+        knows what it observed and nothing else, and quietly rendering unseen
+        memory as zero would invent facts.
+        """
+        sp_name = next((r for r in ("rsp", "esp", "sp") if r in t.reg_at), "")
+        sp = t.register(sp_name, self.idx) if sp_name else None
+        out = Text()
+        if sp is None:
+            self.query_one("#trace-stack", Static).update(out)
+            return
+        width = 8 if (t.info and "64" in (t.info.arch or "")) else 4
+        out.append(f" stack ({sp_name})\n", _S_DIM)
+        for k in range(self.STACK_WORDS):
+            a = sp + k * width
+            data, known = t.memory_raw(a, width, self.idx)
+            out.append(" \u25b8" if k == 0 else "  ", _S_MNEM)
+            out.append(f"{a:012x} ", _S_ADDR)
+            if all(known):
+                v = int.from_bytes(data, "little")
+                out.append(f"{v:0{width * 2}x}\n", _S_DATA if k == 0 else _S_INSN)
+            elif any(known):
+                out.append("".join(f"{b:02x}" if known[i] else "??"
+                                   for i, b in enumerate(data)) + "\n", _S_INSN)
+            else:
+                out.append("?" * (width * 2) + "\n", _S_SEP)
+        self.query_one("#trace-stack", Static).update(out)
+
+
 class TraceTimeline(Static):
     """The trace as a vertical bar: where you are, and where you've been.
 
@@ -3147,6 +3218,7 @@ class IdaTui(App):
     #trace-dock { dock: right; width: 34; background: $surface; border-left: solid $panel; }
     #trace-head { height: 2; padding: 0 1; background: $panel; }
     #trace-regs { height: auto; padding: 1 0 0 0; }
+    #trace-stack { height: auto; padding: 1 0 0 0; }
     #trace-timeline { height: 1fr; padding: 1 0 0 0; }
     #load-note { height: 2; padding: 1 1 0 1; color: $text-muted; }
     /* Cap the processor list so the ADDRESS FIELD is always on screen: with the
@@ -5588,6 +5660,13 @@ class IdaTui(App):
         t = self._trace
         if t is None:
             return
+        try:
+            hx = self.query_one(HexView)
+            hx.trace, hx.trace_idx = t, self._t
+            if hx.display:
+                hx.refresh()
+        except Exception:  # noqa: BLE001 -- not mounted yet
+            pass
         trail = t.trail(self._t)
         try:
             lst = self.query_one(ListingView)
diff --git a/idatui/trace.py b/idatui/trace.py
index 2afc8f6..931f918 100644
--- a/idatui/trace.py
+++ b/idatui/trace.py
@@ -76,7 +76,14 @@ class TraceInfo:
 
 @dataclass
 class MemOp:
-    """One memory access made by one instruction."""
+    """One memory access made by one instruction.
+
+    ``addr`` is the address the TRACE recorded — not slid onto the database.
+    Most accesses are stack or heap, which have no counterpart in the database
+    at all, and applying the image's relocation to a stack pointer produces a
+    nonsense address (it went negative in testing). Only addresses inside the
+    image can be translated, and the caller knows when that applies.
+    """
 
     addr: int
     data: bytes
@@ -116,6 +123,10 @@ class Trace:
     mem_row: array.array = field(default_factory=lambda: array.array("I"))
     #: applied so trace addresses line up with the database (see ``rebase``).
     slide: int = 0
+    #: accesses ordered by address, built on first memory query.
+    _mem_order: list | None = None
+    _mem_starts: list = field(default_factory=list)
+    _mem_maxlen: int = 0
 
     # -- construction ------------------------------------------------------ #
     @classmethod
@@ -266,11 +277,111 @@ class Trace:
         out = []
         for k in range(lo, hi):
             off, ln = self.mem_off[k], self.mem_len[k]
-            out.append(MemOp(addr=self.mem_addr[k] + self.slide,
+            out.append(MemOp(addr=self.mem_addr[k],
                              data=bytes(self.mem_blob[off:off + ln]),
                              write=bool(self.mem_write[k])))
         return out
 
+    # -- memory state ------------------------------------------------------- #
+    def _mem_index(self) -> None:
+        """Order the accesses by address, once.
+
+        Queries ask "what was at this window at time t", so the accesses that
+        matter are the few touching that window — not the tens of thousands in
+        the trace. Sorting by address makes those a bisect away; sorting by time
+        (the order they arrive in) would mean scanning everything per repaint.
+        """
+        if self._mem_order is not None:
+            return
+        order = sorted(range(len(self.mem_addr)), key=lambda k: self.mem_addr[k])
+        self._mem_order = order
+        self._mem_starts = [self.mem_addr[k] for k in order]
+        self._mem_maxlen = max(self.mem_len) if len(self.mem_len) else 0
+
+    def memory_raw(self, addr: int, length: int,
+                   idx: int | None = None) -> tuple[bytes, bytes]:
+        """Memory at a TRACE address (no slide).
+
+        The stack lives here. Measured on two real traces, 0% of memory accesses
+        fall inside the image — every one is stack or heap — so a query that
+        insists on database addresses can't answer the question anyone actually
+        has about memory in a trace.
+        """
+        return self.memory(addr + self.slide, length, idx)
+
+    def memory(self, addr: int, length: int,
+               idx: int | None = None) -> tuple[bytes, bytes]:
+        """``(data, known)`` for ``length`` bytes at ``addr`` as of ``idx``.
+
+        ``known`` is a byte-per-byte mask: a trace only says what it saw, so a
+        byte nobody read or wrote is genuinely unknown and must not be drawn as
+        zero. That distinction is the whole value of reading memory from a trace
+        rather than from the database — the database has the file's bytes, the
+        trace has what was actually there at that instant.
+
+        Reads count as evidence, not just writes: an instruction reading a byte
+        reveals what it held then.
+        """
+        if idx is None:
+            idx = self.length - 1
+        length = max(int(length), 0)
+        out, known = bytearray(length), bytearray(length)
+        if not length or not len(self.mem_idx):
+            return bytes(out), bytes(known)
+        self._mem_index()
+        raw = addr - self.slide
+        best = [-1] * length
+        import bisect as _b
+        lo = _b.bisect_left(self._mem_starts, raw - self._mem_maxlen)
+        hi = _b.bisect_right(self._mem_starts, raw + length - 1)
+        for pos in range(lo, hi):
+            k = self._mem_order[pos]
+            t = self.mem_idx[k]
+            if t > idx:
+                continue
+            a, ln = self.mem_addr[k], self.mem_len[k]
+            s, e = max(a, raw), min(a + ln, raw + length)
+            if s >= e:
+                continue
+            off = self.mem_off[k]
+            for b in range(s, e):
+                j = b - raw
+                # >= not >: several accesses can share a timestamp (an
+                # instruction that reads and writes), and the later entry on the
+                # line is the one that stands.
+                if t >= best[j]:
+                    best[j] = t
+                    out[j] = self.mem_blob[off + (b - a)]
+                    known[j] = 1
+        return bytes(out), bytes(known)
+
+    def memory_writes(self, addr: int, length: int) -> list[int]:
+        """Timestamps that WROTE any byte of ``[addr, addr+length)``."""
+        return self._mem_touch(addr, length, writes=True)
+
+    def memory_accesses(self, addr: int, length: int) -> list[int]:
+        """Timestamps that read or wrote any byte of the range."""
+        return self._mem_touch(addr, length, writes=False)
+
+    def _mem_touch(self, addr: int, length: int, writes: bool) -> list[int]:
+        if not len(self.mem_idx) or length <= 0:
+            return []
+        self._mem_index()
+        raw = addr - self.slide
+        import bisect as _b
+        lo = _b.bisect_left(self._mem_starts, raw - self._mem_maxlen)
+        hi = _b.bisect_right(self._mem_starts, raw + length - 1)
+        out = set()
+        for pos in range(lo, hi):
+            k = self._mem_order[pos]
+            a, ln = self.mem_addr[k], self.mem_len[k]
+            if a + ln <= raw or a >= raw + length:
+                continue
+            if writes and not self.mem_write[k]:
+                continue
+            out.add(self.mem_idx[k])
+        return sorted(out)
+
     # -- execution queries (what painting is built on) ---------------------- #
     def executions(self, ea: int) -> array.array:
         """Every timestamp that executed ``ea`` (database address)."""