not getting record returned from boto3 dynamoDB scan

I am using boto3 to scan a DynamoDB table to find records with a certain ID (articleID or imageID).

For some valid articleIDs the scan returns zero results. If I do the scan with the exact same articleID in the DynamoDB console, it works fine. Through boto3, zero results. If I pick another articleID, the results return as expected.

For the records that don’t return, it also won’t return using the imageID. For the record that does work, it works for either ID. I can’t see any difference between the records. The only thing I can think of is that the ones that don’t work time out, but is there a setting for that in boto3?

Table name articleImages Primary partition key imageID (String) Primary sort key articleID (String)

db = boto3.resource('dynamodb')
imageTable = db.Table('articleImages')
articleID = "Xxp6ntkoUnX4NDEqn8gSVo" #THIS DOESNT WORK HERE BUT DOES IN CONSOLE
articleID = "EqVxu2tcP7EavFGPDw7R5A" # THIS ONE WORKS HERE
response = imageTable.scan(
FilterExpression=Attr('articleID').eq(articleID)
)

thanks in advance

[robertchen]

Limit=1000 does not work, have to do pagination or create an index for query

[harshgangwar]

One solution using paginator, You can take reference from there: https://stackoverflow.com/questions/36780856/complete-scan-of-dynamodb-with-boto3