distinguish 'consequental' clicks (links etc.) vs. clicks/touches on blank space

At the moment, the rrweb MouseInteraction events record a Click with a x/y co-ordinate but without reference to the underlying event that was clicked upon. This could be retrieved during playback by calling elementFromPoint after the event is executed, but for my usecase — labelling/describing the clicks on the timeline — this is too late. (I haven’t tested whether elementFromPoint works or is accurate during playback — the pointer-events:none style on the rrweb container may hamper it).

Identifying the element would be great; it would also be great if we could identify whether the click/touch results in a page load (click on a link) or triggers some other javascript action (e.g. a modal popup) There’s also situations where e.g. a click on a link opens the link in a new background tab, so recording which meta keys are depressed would also be useful. I’m not sure if these could be teased out, so I guess identifying the element and including it in the event would be a great first step.

I should be able to get around to implementing this but it’s not high priority at the moment so just raising here in case there’s prior work or other things to be concerned about.

Aside: some other commercial offerings label multiple clicks on blank space ‘rage clicks’, but personally I don’t find this useful or accurate.

[eoghanmurray]

ML clustering to determine and label types of behavior… not sure that’s in scope of this project

LOL that’s definitely out of scope! The focus here is what can be determined with DOM/browser tech.

I’ve gone ahead and implemented the href recording in #659 — for review.

[eoghanmurray]

(I deleted the first of your dupe comments … I presume the first one was a draft of the second?!)