Persistent rtree for SQLGraph?

[yfukai]

Generating Rtree for spatial_filter takes 〜10min for 2-dim 20M-node graph.
Backends such as SQLite and PostgreSQL have their own Rtree implementations, and it would be great the graphs natively supports those persistent Rtree index.

[JoOkuma]

Hi @yfukai,
Do you know if these implementations work for 3D coordinates?
@kephale recommended me to use his package, https://github.com/kephale/rstar-python
We can benchmark to see if it's faster.

[JoOkuma]

@yfukai, I'm a bit behind reviewing your PRs. I'll try to complete them by the end of this week.

[yfukai]

3D coordinates

Yeah they seem to work, but I'll have a closer look!

rstar

There're several impl of in-memory rtree, let's benchmark them!

[JoOkuma]

@yfukai, that's awesome, if they work on 3D, I would go with the SQL version as you suggested

[yfukai]

I found there's no common interface for different backends and we need to do different things for different backends. It's beyond my capacity for now and I'd set this as pending...