question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

[Question] Recommendation for A/B testing a particular JavaScript snippet with Web Vitals Report?

See original GitHub issue

Hello,

We are looking to implement Core Web Vitals first on our site, then eventually on our clients’ websites. Particularly, we want to measure the web vitals both with and without a particular JavaScript snippet running on the page, and be able to easily compare/contrast these values to understand the UX impact of the snippet.

We can implement a “coin flip” mechanic that determines whether or not to inject the JavaScript, and report on the Core Web Vitals in every case.

It seems like we might somehow be able to take advantage of eventLabel and grouping (or maybe some other GA event property), but are unsure how we can configure web-vitals-report correctly for this particular use-case.

Are there any recommendations on how to approach this problem? Any help would be greatly appreciated.

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Comments:5

github_iconTop GitHub Comments

1reaction
philipwaltoncommented, Jan 15, 2021

Try using a custom date range. If I recall correctly, “Last 7 days” does not include the current day.

1reaction
justinhelmercommented, Jan 14, 2021

@philipwalton - Wow, this is incredibly useful. I hope other stumble upon this as well, as it is invaluable information.

Thanks to your help in getting the UMD+polyfill reporting working (currently working in Chrome), we can start to capture values and set up web-vitals-report, at which point I will be able to come back and fully digest this.

Read more comments on GitHub >

github_iconTop Results From Across the Web

How to Improve Core Web Vitals when A/B Testing with Convert
In this article, we'll explore how the recent Core Web Vitals update can affect your A/B testing and some best practices you can...
Read more >
Not getting metrics reported for anything but TTFP and CLS (in ...
[Question] Recommendation for A/B testing a particular JavaScript snippet with Web Vitals Report? GoogleChromeLabs/web-vitals-report#1.
Read more >
What is A/B Testing? A Practical Guide With Examples | VWO
A/B testing (also called split testing) is comparing two versions of a web page to figure out the better performing variation. Learn more...
Read more >
A Guide to A/B Testing with Google Analytics - Crazy Egg
Learn how to do an AB testing with Google Analytics. In this article, I'll show you a testing tool that's readily available to...
Read more >
Top FAQs for SEO Split-Testing with SplitSignal - Semrush
Users can run as many tests as your website allows, as long as each test meets the minimum thresholds for traffic & pages....
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found