unable to fetch data from the next page (more than 1000 records)

[asmaMdi]

I'm using pyodata to get data from odata service but but I'm getting only the first 1000 records. help me how to get it.
TIA

[filak-sap]

Are you sure the service returns more entities in browser? I am not aware of any limit.
You might need to use $skip and $top parameters.
*.get_entities().skip(1000).top(2000).*

[asmaMdi]

in the browser the service returns the first 1000 records only. and there is a link to the next page at the end. I will try .get_entities().skip(1000).top(2000).*
Thank you for your quick reply

[asmaMdi]

Thank you. It works

[filak-sap]

@asmaMdi May I know what service have this behaviour? We have a similar problem in #101 - it would be cool if we can compile a list of services which have internal implicit limits on get entity set size.

[rettichschnidi]

@filak-sap Curia Vista, the business database of the Swiss Parlament (https://ws.parlament.ch/odata.svc) exposes this behavior and limits its responses to 1000 for some entities (e.g. MemberCommittee, MemberCommitteeHistory, MemberCouncilHistory, MemberParty).

For such partial listings, _next is included as described in 6. Representing Collections of Entries:

In response payloads, representing Collections of Entries, if the server does not include an object for every Entry in the Collection of Entries identified by the request URI then the response represents a partial listings of the Collection. In this case, "__next" name/value pair is included to indicate the response represents a partial listing.

It seems to me that using the URL provided by _next instead of combining top/skip would be preferable.