Is there a way to dynamic paging the orion context with the specific type in Idra?

[zongring]

1、As i know the NGSI v2/entities get rest api support the limit(up to 1000) and offset parameter，I setup the idra Catalogues below:
[{
"title": "SampleData",
"description": "",
"theme": [
"GOVE"
],
"keywords": [
"SampleData"
],
"distributions": [
{
"title": "SampleData",
"description": "",
"distributionAdditionalConfig": {
"query": "type=SampleData&options=keyValues,count",
"fiwareService": "",
"fiwareServicePath": ""
},
"mediaType": "",
"license": {
"uri": "",
"name": "license",
"type": "",
"versionInfo": ""
}
}
]
}
]

the count of SampleData is 20000+ or more but the v2/entities get rest can only return 1000 max records。how can i deal with this condition.

2、the Idra datalet table is then same scene，is there any way to dynamic paging the CB datas in the table?

Look forward to your reply

thanks!

[robcalla]

Dear @zongring, thanks for using Idra.
The automatic pagination at data level is not supported. A possible solution might be defining several distributions where you can specify in the query the offset and limit parameters supported by the CB, e.g.:

"distributionAdditionalConfig": {
"query": "type=SampleData&options=keyValues,count&offset=0&limit=1000",
"fiwareService": "",
"fiwareServicePath": ""
},

In this specific case, considering that the count is 20000+ entities you should define at least 20 distributions managing the offset appropriately (the limit will be fixed at 1000 considering CB fixed limit).

About the datalets, the situation is the same as the one described above. Since the component that manages the datalets relies on the data provided by each distribution.

Please, let me know if you need further support.