H-6617: Create custom graph rendering pipeline inside frontend

[indietyp]

🌟 What is the purpose of this PR?

🔗 Related links

• ...

🚫 Blocked by

• ...

🔍 What does this change?

• ...

Pre-Merge Checklist 🚀

🚢 Has this modified a publishable library?

This PR:

• does not modify any publishable blocks or libraries, or modifications do not need publishing
• modifies an npm-publishable library and I have added a changeset file(s)
• modifies a Cargo-publishable library and I have amended the version
• modifies a Cargo-publishable library, but it is not yet ready to publish
• modifies a block that will need publishing via GitHub action once merged
• I am unsure / need advice

📜 Does this require a change to the docs?

The changes in this PR:

• are internal and do not require a docs change
• are in a state where docs changes are not yet required but will be
  • this is tracked in: Insert Link Here
• require changes to docs which are made as part of this PR
• require changes to docs which are not made in this PR
  • Provide more detail here
• I am unsure / need advice

🕸️ Does this require a change to the Turbo Graph?

The changes in this PR:

• do not affect the execution graph
• affected the execution graph, and the turbo.json's have been updated to reflect this
• I am unsure / need advice

⚠️ Known issues

🐾 Next steps

🛡 What tests cover this?

❓ How to test this?

1. Checkout the branch / view the deployment
2. Try X
3. Confirm that Y

📹 Demo

[github-actions]

Benchmark results

@rust/hash-graph-benches – Integrations

policy_resolution_large

Function	Value	Mean	Flame graphs
resolve_policies_for_actor	user: empty, selectivity: high, policies: 2002	$$27.6 \mathrm{ms} \pm 257 \mathrm{μs}\left({\color{gray}-2.287 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: empty, selectivity: low, policies: 1	$$3.43 \mathrm{ms} \pm 18.3 \mathrm{μs}\left({\color{gray}-0.280 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: empty, selectivity: medium, policies: 1002	$$12.5 \mathrm{ms} \pm 110 \mathrm{μs}\left({\color{gray}-1.764 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: seeded, selectivity: high, policies: 3314	$$43.2 \mathrm{ms} \pm 362 \mathrm{μs}\left({\color{gray}-0.427 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: seeded, selectivity: low, policies: 1	$$15.4 \mathrm{ms} \pm 178 \mathrm{μs}\left({\color{red}5.96 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: seeded, selectivity: medium, policies: 1527	$$24.3 \mathrm{ms} \pm 175 \mathrm{μs}\left({\color{gray}1.07 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: system, selectivity: high, policies: 2078	$$29.0 \mathrm{ms} \pm 186 \mathrm{μs}\left({\color{gray}3.20 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: system, selectivity: low, policies: 1	$$3.79 \mathrm{ms} \pm 24.6 \mathrm{μs}\left({\color{gray}0.213 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: system, selectivity: medium, policies: 1033	$$13.7 \mathrm{ms} \pm 109 \mathrm{μs}\left({\color{gray}-1.480 \mathrm{\%}}\right) $$	Flame Graph

policy_resolution_medium

Function	Value	Mean	Flame graphs
resolve_policies_for_actor	user: empty, selectivity: high, policies: 102	$$3.90 \mathrm{ms} \pm 35.6 \mathrm{μs}\left({\color{gray}1.59 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: empty, selectivity: low, policies: 1	$$3.03 \mathrm{ms} \pm 14.9 \mathrm{μs}\left({\color{gray}1.20 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: empty, selectivity: medium, policies: 52	$$3.37 \mathrm{ms} \pm 16.3 \mathrm{μs}\left({\color{gray}0.196 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: seeded, selectivity: high, policies: 269	$$5.28 \mathrm{ms} \pm 45.8 \mathrm{μs}\left({\color{gray}1.38 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: seeded, selectivity: low, policies: 1	$$3.61 \mathrm{ms} \pm 26.5 \mathrm{μs}\left({\color{gray}0.951 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: seeded, selectivity: medium, policies: 108	$$4.19 \mathrm{ms} \pm 28.3 \mathrm{μs}\left({\color{gray}0.254 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: system, selectivity: high, policies: 133	$$4.45 \mathrm{ms} \pm 23.7 \mathrm{μs}\left({\color{gray}-0.795 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: system, selectivity: low, policies: 1	$$3.51 \mathrm{ms} \pm 25.7 \mathrm{μs}\left({\color{gray}1.45 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: system, selectivity: medium, policies: 63	$$4.14 \mathrm{ms} \pm 26.4 \mathrm{μs}\left({\color{gray}0.129 \mathrm{\%}}\right) $$	Flame Graph

policy_resolution_none

Function	Value	Mean	Flame graphs
resolve_policies_for_actor	user: empty, selectivity: high, policies: 2	$$2.65 \mathrm{ms} \pm 17.4 \mathrm{μs}\left({\color{gray}-0.680 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: empty, selectivity: low, policies: 1	$$2.53 \mathrm{ms} \pm 12.3 \mathrm{μs}\left({\color{gray}0.200 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: empty, selectivity: medium, policies: 2	$$2.61 \mathrm{ms} \pm 14.4 \mathrm{μs}\left({\color{gray}-1.279 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: system, selectivity: high, policies: 8	$$2.89 \mathrm{ms} \pm 18.4 \mathrm{μs}\left({\color{gray}-2.950 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: system, selectivity: low, policies: 1	$$2.68 \mathrm{ms} \pm 15.7 \mathrm{μs}\left({\color{gray}-1.054 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: system, selectivity: medium, policies: 3	$$2.88 \mathrm{ms} \pm 27.8 \mathrm{μs}\left({\color{gray}-2.095 \mathrm{\%}}\right) $$	Flame Graph

policy_resolution_small

Function	Value	Mean	Flame graphs
resolve_policies_for_actor	user: empty, selectivity: high, policies: 52	$$3.08 \mathrm{ms} \pm 16.6 \mathrm{μs}\left({\color{gray}-0.903 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: empty, selectivity: low, policies: 1	$$2.75 \mathrm{ms} \pm 15.3 \mathrm{μs}\left({\color{gray}-1.967 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: empty, selectivity: medium, policies: 26	$$3.00 \mathrm{ms} \pm 15.7 \mathrm{μs}\left({\color{gray}-1.712 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: seeded, selectivity: high, policies: 94	$$3.48 \mathrm{ms} \pm 22.6 \mathrm{μs}\left({\color{gray}-0.403 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: seeded, selectivity: low, policies: 1	$$3.00 \mathrm{ms} \pm 18.1 \mathrm{μs}\left({\color{gray}-0.742 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: seeded, selectivity: medium, policies: 27	$$3.33 \mathrm{ms} \pm 24.1 \mathrm{μs}\left({\color{gray}0.281 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: system, selectivity: high, policies: 66	$$3.42 \mathrm{ms} \pm 22.9 \mathrm{μs}\left({\color{gray}-0.353 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: system, selectivity: low, policies: 1	$$2.96 \mathrm{ms} \pm 15.0 \mathrm{μs}\left({\color{gray}-1.549 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: system, selectivity: medium, policies: 29	$$3.38 \mathrm{ms} \pm 20.6 \mathrm{μs}\left({\color{gray}-0.992 \mathrm{\%}}\right) $$	Flame Graph

read_scaling_complete

Function	Value	Mean	Flame graphs
entity_by_id;one_depth	1 entities	$$43.4 \mathrm{ms} \pm 268 \mathrm{μs}\left({\color{gray}2.50 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id;one_depth	10 entities	$$35.7 \mathrm{ms} \pm 200 \mathrm{μs}\left({\color{red}6.19 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id;one_depth	25 entities	$$39.0 \mathrm{ms} \pm 249 \mathrm{μs}\left({\color{red}6.21 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id;one_depth	5 entities	$$33.2 \mathrm{ms} \pm 189 \mathrm{μs}\left({\color{gray}1.10 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id;one_depth	50 entities	$$44.7 \mathrm{ms} \pm 298 \mathrm{μs}\left({\color{gray}3.13 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id;two_depth	1 entities	$$50.7 \mathrm{ms} \pm 332 \mathrm{μs}\left({\color{gray}-0.543 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id;two_depth	10 entities	$$40.3 \mathrm{ms} \pm 278 \mathrm{μs}\left({\color{gray}-1.575 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id;two_depth	25 entities	$$91.9 \mathrm{ms} \pm 589 \mathrm{μs}\left({\color{gray}3.71 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id;two_depth	5 entities	$$34.5 \mathrm{ms} \pm 210 \mathrm{μs}\left({\color{gray}-2.155 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id;two_depth	50 entities	$$310 \mathrm{ms} \pm 1.20 \mathrm{ms}\left({\color{red}6.95 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id;zero_depth	1 entities	$$10.6 \mathrm{ms} \pm 66.9 \mathrm{μs}\left({\color{gray}-2.326 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id;zero_depth	10 entities	$$10.7 \mathrm{ms} \pm 59.6 \mathrm{μs}\left({\color{gray}-4.313 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id;zero_depth	25 entities	$$10.7 \mathrm{ms} \pm 54.9 \mathrm{μs}\left({\color{gray}-1.491 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id;zero_depth	5 entities	$$10.6 \mathrm{ms} \pm 58.4 \mathrm{μs}\left({\color{gray}-1.509 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id;zero_depth	50 entities	$$11.2 \mathrm{ms} \pm 65.5 \mathrm{μs}\left({\color{gray}-2.041 \mathrm{\%}}\right) $$	Flame Graph

read_scaling_linkless

Function	Value	Mean	Flame graphs
entity_by_id	1 entities	$$11.2 \mathrm{ms} \pm 72.8 \mathrm{μs}\left({\color{gray}-0.856 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id	10 entities	$$11.0 \mathrm{ms} \pm 62.9 \mathrm{μs}\left({\color{gray}-2.953 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id	100 entities	$$11.1 \mathrm{ms} \pm 62.0 \mathrm{μs}\left({\color{gray}0.224 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id	1000 entities	$$11.4 \mathrm{ms} \pm 67.6 \mathrm{μs}\left({\color{red}5.86 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id	10000 entities	$$10.8 \mathrm{ms} \pm 68.7 \mathrm{μs}\left({\color{gray}-0.600 \mathrm{\%}}\right) $$	Flame Graph

representative_read_entity

Function	Value	Mean	Flame graphs
entity_by_id	entity type ID: https://blockprotocol.org/@alice/types/entity-type/block/v/1	$$10.9 \mathrm{ms} \pm 60.3 \mathrm{μs}\left({\color{gray}-2.666 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id	entity type ID: https://blockprotocol.org/@alice/types/entity-type/book/v/1	$$10.9 \mathrm{ms} \pm 61.5 \mathrm{μs}\left({\color{gray}-4.206 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id	entity type ID: https://blockprotocol.org/@alice/types/entity-type/building/v/1	$$10.8 \mathrm{ms} \pm 85.6 \mathrm{μs}\left({\color{gray}-3.052 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id	entity type ID: https://blockprotocol.org/@alice/types/entity-type/organization/v/1	$$10.7 \mathrm{ms} \pm 61.4 \mathrm{μs}\left({\color{gray}-2.675 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id	entity type ID: https://blockprotocol.org/@alice/types/entity-type/page/v/2	$$11.0 \mathrm{ms} \pm 76.3 \mathrm{μs}\left({\color{gray}-2.872 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id	entity type ID: https://blockprotocol.org/@alice/types/entity-type/person/v/1	$$10.9 \mathrm{ms} \pm 63.8 \mathrm{μs}\left({\color{gray}-1.249 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id	entity type ID: https://blockprotocol.org/@alice/types/entity-type/playlist/v/1	$$10.8 \mathrm{ms} \pm 69.2 \mathrm{μs}\left({\color{gray}-3.175 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id	entity type ID: https://blockprotocol.org/@alice/types/entity-type/song/v/1	$$10.8 \mathrm{ms} \pm 64.1 \mathrm{μs}\left({\color{gray}-2.090 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id	entity type ID: https://blockprotocol.org/@alice/types/entity-type/uk-address/v/1	$$11.0 \mathrm{ms} \pm 83.2 \mathrm{μs}\left({\color{gray}0.284 \mathrm{\%}}\right) $$	Flame Graph

representative_read_entity_type

Function	Value	Mean	Flame graphs
get_entity_type_by_id	Account ID: bf5a9ef5-dc3b-43cf-a291-6210c0321eba	$$8.68 \mathrm{ms} \pm 44.1 \mathrm{μs}\left({\color{gray}-0.381 \mathrm{\%}}\right) $$	Flame Graph

representative_read_multiple_entities

Function	Value	Mean	Flame graphs
entity_by_property	traversal_paths=0	0	$$56.1 \mathrm{ms} \pm 435 \mathrm{μs}\left({\color{gray}1.07 \mathrm{\%}}\right) $$
entity_by_property	traversal_paths=255	1,resolve_depths=inherit:1;values:255;properties:255;links:127;link_dests:126;type:true	$$110 \mathrm{ms} \pm 596 \mathrm{μs}\left({\color{gray}-0.925 \mathrm{\%}}\right) $$
entity_by_property	traversal_paths=2	1,resolve_depths=inherit:0;values:0;properties:0;links:0;link_dests:0;type:false	$$66.2 \mathrm{ms} \pm 446 \mathrm{μs}\left({\color{red}6.05 \mathrm{\%}}\right) $$
entity_by_property	traversal_paths=2	1,resolve_depths=inherit:0;values:0;properties:0;links:1;link_dests:0;type:true	$$73.6 \mathrm{ms} \pm 501 \mathrm{μs}\left({\color{gray}4.97 \mathrm{\%}}\right) $$
entity_by_property	traversal_paths=2	1,resolve_depths=inherit:0;values:0;properties:2;links:1;link_dests:0;type:true	$$81.5 \mathrm{ms} \pm 546 \mathrm{μs}\left({\color{gray}2.13 \mathrm{\%}}\right) $$
entity_by_property	traversal_paths=2	1,resolve_depths=inherit:0;values:2;properties:2;links:1;link_dests:0;type:true	$$90.9 \mathrm{ms} \pm 510 \mathrm{μs}\left({\color{gray}2.57 \mathrm{\%}}\right) $$
link_by_source_by_property	traversal_paths=0	0	$$43.4 \mathrm{ms} \pm 268 \mathrm{μs}\left({\color{gray}-3.667 \mathrm{\%}}\right) $$
link_by_source_by_property	traversal_paths=255	1,resolve_depths=inherit:1;values:255;properties:255;links:127;link_dests:126;type:true	$$73.7 \mathrm{ms} \pm 647 \mathrm{μs}\left({\color{gray}-4.369 \mathrm{\%}}\right) $$
link_by_source_by_property	traversal_paths=2	1,resolve_depths=inherit:0;values:0;properties:0;links:0;link_dests:0;type:false	$$50.6 \mathrm{ms} \pm 416 \mathrm{μs}\left({\color{gray}-2.742 \mathrm{\%}}\right) $$
link_by_source_by_property	traversal_paths=2	1,resolve_depths=inherit:0;values:0;properties:0;links:1;link_dests:0;type:true	$$59.6 \mathrm{ms} \pm 376 \mathrm{μs}\left({\color{lightgreen}-5.528 \mathrm{\%}}\right) $$
link_by_source_by_property	traversal_paths=2	1,resolve_depths=inherit:0;values:0;properties:2;links:1;link_dests:0;type:true	$$63.3 \mathrm{ms} \pm 377 \mathrm{μs}\left({\color{gray}-3.300 \mathrm{\%}}\right) $$
link_by_source_by_property	traversal_paths=2	1,resolve_depths=inherit:0;values:2;properties:2;links:1;link_dests:0;type:true	$$63.0 \mathrm{ms} \pm 471 \mathrm{μs}\left({\color{gray}-3.274 \mathrm{\%}}\right) $$

scenarios

Function	Value	Mean	Flame graphs
full_test	query-limited	$$122 \mathrm{ms} \pm 614 \mathrm{μs}\left({\color{gray}-2.491 \mathrm{\%}}\right) $$	Flame Graph
full_test	query-unlimited	$$133 \mathrm{ms} \pm 663 \mathrm{μs}\left({\color{gray}-1.230 \mathrm{\%}}\right) $$	Flame Graph
linked_queries	query-limited	$$22.3 \mathrm{ms} \pm 309 \mathrm{μs}\left({\color{red}15.4 \mathrm{\%}}\right) $$	Flame Graph
linked_queries	query-unlimited	$$528 \mathrm{ms} \pm 1.21 \mathrm{ms}\left({\color{gray}-0.602 \mathrm{\%}}\right) $$	Flame Graph