Feature Request: Downloading metrics from multiple runs is slow due to init.

Usually, to make statistical analysis for experiments one needs to download metrics from multiple runs, like 50, 100 or even more. But downloading metrics or files from runs takes a lot of time since for each run, one need to execute neptune.init, which itself takes around 2 seconds. For 1000 runs it is 2000 seconds ~= 30 minutes. Would be nice if we could connect to the server only once but download things from multiple runs.

[aniezurawski]

Hi @wjaskowski

I don’t want to promise too much too early but there is a chance for some performance improvement for this case (multiple Runs) in some near future.

[wjaskowski]

Thank you! There definitely is. It is hard to quantify it since it depends on the use case.

On Thu, 30 Sept 2021 at 10:39, Adam Nieżurawski @.***> wrote:

@wjaskowski https://github.com/wjaskowski Please try new release 0.12.0. And let me know if there’s any difference in performance. 😃

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/neptune-ai/neptune-client/issues/683#issuecomment-931043660, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABFZEHLHQPUKGLB5JR5H663UEQO47ANCNFSM5DLIH3QQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.