ESMAtlas api access: Rate limit?

Hi,

I would like to automatically retrieve structures from ESMAtlas. Basically I have a list of MGinfy IDs that I want to retrieve.

I do that using the following:

def get_esm_pdb_file(mgnify_id, out_dir):
    url = f'https://api.esmatlas.com/fetchPredictedStructure/{mgnify_id}.pdb'
    response = requests.get(url, stream=True)
    if response.status_code == 200:
        pdb_file = os.path.join(out_dir,f'{mgnify_id}.pdb')
        with open(pdb_file, 'w') as f:
            f.write(response.text)
    else:
        print(mgnify_id, response.status_code)
        print(response.text)

To speed it up, I parallelize it over my list using a ProcessPool. For some IDs I then get the following:

MGYP000547115894 403
{"message":"Forbidden"}
MGYP000526977164 403
{"message":"Forbidden"}
MGYP003555372774 403
{"message":"Forbidden"}

Could you provide some details if/what rate limiting is in place for querying ESMAtlas, or if there is another way to retrieve structure files?

Thanks!

[fteufel]

Nevermind, I ran a few more test cases and I’m sure it goes faster now.

[tomsercu]

This makes a lot of sense, we’ll increase rate limits for all GET requests which just fetch data from the atlas.