question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

[BUG] `exclude_unknowns=False` makes evaluation fail

See original GitHub issue

Hello guys, great work, way better than Microsoft! I have a small issue, please read below:

Description

If I set exclude_unknowns=False then all the ratings/rankings fail with a similar error: e.g. IndexError('index 1840 is out of bounds for axis 0 with size 1840')

In which platform does it happen?

Linux 5.11.0-36-generic

How do we replicate the issue?

This is easy, just make sure to have non-zeros for: Number of unknown users = 5 Number of unknown items = 4 after when doing RatioSplit

Expected behavior (i.e. solution)

I would still expect to get the scores even when there are non-matching indices between train_set and test_set

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:7 (4 by maintainers)

github_iconTop GitHub Comments

1reaction
tqtgcommented, Nov 10, 2021

Ideally, all models should be able to handle unknown users and items. However, some specific implementations didn’t take that into account. We don’t have such a list of models that can handle unknown cases, though the majority can do so.

0reactions
vlainiccommented, Nov 10, 2021

Yeah, that would be ideal 😃 Thank you once more, I will close the issue now.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Difference between Defect, Error, Bug, Failure and Fault!
An error in software or hardware that causes a program to malfunction. A bug is the terminology of Tester. FAILURE: A failure is...
Read more >
Cisco Bug: CSCvz77836 - ISE 3.0 evaluation expiry error on ...
Symptom: "You have 5 days remaining in Evaluation mode" Error displayed on ISE GUI every day upon login Conditions: ISE 3.0.
Read more >
571208 – Evaluation error when using try-catch in the snippet
Reason(s): Syntax error, insert ";" to complete BlockStatements Using this try{ return 10; } catch (Exception e) { } will ends up in...
Read more >
SOBER: Statistical Model-based Bug Localization
In this paper, we propose a new statistical model-based approach, called. SOBER, which localizes software bugs without any prior knowledge of program semantics....
Read more >
JDK-6486430 Compiler fails to reject access to static ... - Bug ID
The compiler fails to reject this program: public class Test<T extends Number> ... EVALUATION JLS 8.5 permits member types, including static member types, ......
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found