Memory Overallocation from tfjs version 0.12.4

TensorFlow.js version

0.12.4 ~ 0.12.6

Browser version

Chrome 68.0.3440.106 , Firefox 61.0.2

Describe the problem or feature request

From tensorflow.js 0.12.4, when running a model with large input, RAM memory is abnormally allocated to the extent that it can’t handle the data.

Code to reproduce the bug / link to feature request

With tfjs posenet demo official repository, the bug can be reproduced.

To see working situation in 0.12.3

1. clone the posenet demo repository, link
2. version up the tfjs version to 0.12.3 by editing package.json (before editing the version is 0.11.4 in master branch)
3. start the demo server: npm i && npm run watch
4. change the input setting, and we can see the memory is in normal situation.

To see memory bug situation in 0.12.4 ~ 0.12.6

1. clone the posenet demo repository, link
2. version up the tfjs version to 0.12.4 by editing package.json (before editing the version is 0.11.4 in master branch)
3. start the demo server: npm i && npm run watch
4. With the same input setting, we can see the memory overallocation with the demo application failing to work

[tafsiri]

@MoonsuCha Thanks this gives us an idea of what could be the cause (paging). Could you add the following lines to camera.js at around line 24 (after the imports):

console.log(tf.getBackend());
console.log(
    'Window Info',
    window.screen.height * window.screen.width * window.devicePixelRatio);
console.log('Paging Threshold', tf.ENV.backend.NUM_BYTES_BEFORE_PAGING);

Could you paste the output you get from that here? It should be at the top of the console

If that paging threshold is too low for an activation it could cause the problem you are seeing (and provide some data for us to fix it).

A workaround you could try is adding the following line after those console logs (near the top of the file).

tf.ENV.backend.NUM_BYTES_BEFORE_PAGING = Infinity;

this should turn of paging and possibly solve the problem (if its what I think it is).

[tehsenaus]

I encountered the same issue when running a model on mobile devices. It turns out it’s easy to reproduce on a PC if you use a small screen width, which triggers paging.