--multi recording network (maybe even more..?) calls prior to measure.start

I’ve noticed that in the waterfall of my --multi script results, there are lines before the URL that is being measured in measure.start.

That could also mean that maybe other things are being recorded and maybe even the results take into account the steps before measure.start, which of course means wrong results.

Here is a waterfall example with the URL being measured highlighted:

And here is my script:

module.exports = async function(context, commands) {
  const login = 'https://hello.com';
  let redirectURL;
  let loadTimeout;

  // If we would like to test in no cache mode or not
  if (context.options.my.nocache) {
    redirectURL = login;
    loadTimeout = 1000;
    context.log.warn('Cache simulation: cache disabled - simulating first comer');
  } else {
    redirectURL = context.options.my.url;
    // We're doing a long timeout so the page will have chance to load all
    // the required items to simulate a page refresh
    loadTimeout = 6000;
    context.log.warn('Cache simulation: cache enabled - simulating page refresh');
  }

  let loginURL = `${login}/session?redirect=${encodeURIComponent(redirectURL)}`;

  // Navigate to login page
  await commands.navigate(loginURL);

  // Login
  await commands.click.byId('sign_in');
  await commands.wait.byId('loginframe', 2000);
  await commands.switch.toFrame('loginframe');

  await commands.addText.byId(context.options.my.userName, 'userName');
  await commands.click.byId('verify_user_btn');
  await commands.wait.byTime(1000);

  await commands.wait.byId('password', 5000);
  await commands.addText.byId(context.options.my.password, 'password');
  await commands.click.byId('btnSubmit');

  // Wait for login to be done depending on the need to reuse cache or not
  context.log.info('Done login step, waiting for redirect to finish');
  await commands.wait.byTime(loadTimeout);

  // Start the measuring of the performance of the tested URL
  return commands.measure.start(context.options.my.url);
};

More info

Version: 8.0.0

[soulgalore]

I’ve updated Visual Metrics but I need to do some more testing before I release it. Thanks for sharing the video @kazazor without it I couldn’t have understood the problem 😃

[soulgalore]

Actually it seems to be a bug in our version of Visual Metric could be that I’ve missed to upgrade to latest version, I’ll have a look.