Migrate to full pydantic 2 support

[ijpulidos]

Since most upstream code has migrated to "pure" pydantic 2, we should consider that ourselves here. Currently we are using the pydantic.v1 API entrypoint to circumvent this.