Skip to content

Plan: Reimagine profile data structure v2#60

Draft
Copilot wants to merge 2 commits intomainfrom
copilot/reimagine-data-structure
Draft

Plan: Reimagine profile data structure v2#60
Copilot wants to merge 2 commits intomainfrom
copilot/reimagine-data-structure

Conversation

Copy link
Copy Markdown

Copilot AI commented Feb 13, 2026

Design plan for a v2 data structure addressing limitations of the current format: pre-aggregation losing individual samples, nested list columns breaking relational semantics, no memory profiling support, and no provenance tracking.

Proposed v2 schema (data-raw/plan-v2.md)

  • sources — new table for provenance (type, URI, timestamp), enabling multi-run combination
  • samples — one row per raw sample (no aggregation), linked to source
  • sample_values — long-form measurements replacing sample_types + samples$value; extensible to memory profiling without schema changes
  • sample_locations — bridge table with depth column, replacing nested list column samples$locations
  • locations, functions — unchanged
  • dm as primary container with defined PK/FK constraints

Migration

profile_v2_from_v1() expands aggregated samples, unnests locations into the bridge table, infers source type from hidden .rprof/.msg components.

Open questions

Includes decisions needed on dm as Imports vs Suggests, class hierarchy, value column type, and depth indexing convention.


💬 We'd love your input! Share your thoughts on Copilot coding agent in our 2 minute survey.

Co-authored-by: krlmlr <1741643+krlmlr@users.noreply.github.com>
Copilot AI changed the title [WIP] Reimagine data structure for profiling data Plan: Reimagine profile data structure v2 Feb 13, 2026
Copilot AI requested a review from krlmlr February 13, 2026 15:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants