registry/records API return maximum 1000 results

Problem description

After harvested more than 1000 organisations(publishers), this API https://knowledgenet.co/api/v0/registry/records?aspect=organization-details&limit=20000 returns maximum 1000 organisation records no matter how the limit param was set.

Problem reproduction steps

Copy and Past the URL to an explorer: https://knowledgenet.co/api/v0/registry/records?aspect=organization-details&limit=20000

Screenshot / Design / File reference

[t83714]

@jevy-wangfei No problem~ I will create a new issue for the changes to organization API and let you once I get a chance to look at it. Regarding collecting all data in one request, it probably won’t be a good idea (in term of reliability) and practical. A better idea of retrieving all records would probably be page by page. Both two APIs supports start & limit parameters for pagination (for registry API better use pageToken. You can use nextPageToken returned from response for next pageToken ). e.g. https://knowledgenet.co/api/v0/registry/records?aspect=organization-details&pageToken=29860&limit=2

[jevy-wangfei]

@t83714 That would be very useful.

Could you please make this API allowing user to collecting all of the records (no limit of 1000 records) on a single API call? Or in another strategy, can you add a page param to allow user searching by pagination: api/v0/registry/records?aspect=organization-details&limit=100&page=100 ?

As discussed above, this issue came from the registry records API limitation of returned records. I hope this API could also provide a way of fetching all records in a similar as the new organisation searching API.

Thanks you very much Jacky.