Incremental DB file growth for Windows
See original GitHub issueI’m currently using lmdbjava 0.6.0 which uses LMDB 0.9.19 (retrieved via Meta.version()).
When using Linux setting a large map size is no problem: The database file grows with the size of the database. This is convenient as I can just use a very large value and I don’t have to care about database resizing.
When using Windows (I’m using Windows 7) the database file size is always the same as the mapping size. E.g. when I set a map size of 100GB then the file size will be 100GB, too.
The LMDB inventor says this behavior has been changed (ITS#8324). The corresponding commit seems to be
fb5a768 Mon Nov 30 19:46:19 2015 ITS#8324 incremental DB file growth for Windows
which is from Nov. 30, 2016 and it should be included in LMDB 0.9.19.
However, the file size behavior under Windows still persists with lmdbjava 0.6.0. So I’m wondering:
- Did I misunderstand what ITS#8324 is supposed to do?
- Did lmdbjava bundle the wrong LMDB version?
- Or does the issue still exist in LMDB?
Any ideas?
Issue Analytics
- State:
- Created 6 years ago
- Reactions:1
- Comments:13 (4 by maintainers)
Top GitHub Comments
LmdbJava bundles LMDB version 0.19.1, which was built from the tag LMDB_0.9.19, commit 14cff072ec29f48093a9d40cc79934cf5376af4a.
While ITS#8324 shows up in several commits as per https://github.com/LMDB/lmdb/search?q=“ITS%238324”&type=Commits&utf8=✓ these do not appear to be included in the above tag or change log (or at least I can’t see that with a quick search).
I see that LMDB 0.9.21 is now out, so I will log a new ticket to get LmdbJava updated to that version and we can see if that included the changes.
It seems like on Windows platform, this still continuous to be a limitation.
“… When using Windows (I’m using Windows 7) the database file size is always the same as the mapping size. E.g. when I set a map size of 100GB then the file size will be 100GB, too. …”
I am on windows 10 , using LMDBJava 0.6.1. Are there workaround, by any chance, developed for this windows-only issue?
I am storing images in LMDB (of over 3mb in size each) – so I am reaching this problem rather quickly.
thx