fix(server): support dedicated backend data structures and serialization logic for vector index.

fix(server): support dedicated backend data structures and serialization logic for vector index. #2178