question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

DynamoDB Table Resource should support Pagination for Scan and Query

See original GitHub issue

The boto3 “Table” Resource API does not provide easy access to paged results when using Scan or Query actions. That’s unlike other high level boto3 Resource APIs like S3 which supports s3.Bucket('bucket').objects.pages().

The underlying DynamoDB client supports pagination, which leaves the boto3 user with the choice between nice attribute access + ugly pagination or ugly attribute access + nice pagination, which is unfortunate.

Issue Analytics

  • State:open
  • Created 4 years ago
  • Reactions:29
  • Comments:5 (1 by maintainers)

github_iconTop GitHub Comments

1reaction
aBurmeseDevcommented, Dec 15, 2022

Thank you all for checking in and apologies for the delay.

We created a backlog item to look into this feature request and if anyone wants to share additional use cases or feedback then please feel free to leave a comment. Although we can’t give a definite timeline at the moment, we’ll make sure to keep it posted as soon as we have an update and please feel free to check back here in the future.

1reaction
tomislackercommented, Sep 22, 2020

@rbu Thank you much for this, I’m also interested. I’m surprised by there being relatively little activity on this issue. But I suppose if the consumers of DynamoDB that aren’t using some sort of ORM already are the main ones affected; I’m not really surprised. They’re already dealing a lot with some gnarly JSON blobs.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Paginating table query results - Amazon DynamoDB
DynamoDB paginates the results from Query operations. With pagination, the Query results are divided into "pages" of data that are 1 MB in...
Read more >
Querying and Pagination with DynamoDB | Cloudbees Blog
This article explains how to work with query and scan operations and when to use which operation. Pagination is very different than SQL ......
Read more >
DynamoDB Pagination - The Ultimate Guide (with Example)
This DynamoDB pagination tutorial covers everything about pages, LastEvaluatedKey, ExclusiveStartKey in the context of Queries and Scans.
Read more >
Paginating table query results - Amazon ... - 亚马逊云科技
With pagination, the Query results are divided into "pages" of data that are 1 MB in size (or less). An application can process...
Read more >
The surprising properties of DynamoDB pagination
This means when a query or a scan operation potentially return more results then the result contains a LastEvaluatedKey field with some value....
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found