mmlspark.lightgbm._LightGBMClassifier does not exist

Describe the bug mmlspark.lightgbm._LightGBMClassifier does not exist

To Reproduce I git cloned the repo and sys.path.append the mmlspark python path, import mmlspark has no issue, but the classifier inside can’t be used

There is no clear instruction on how to install mmlspark for python.

spark = pyspark.sql.SparkSession.builder.appName("MyApp") \
            .config("spark.jars.packages", "com.microsoft.ml.spark:mmlspark_2.11:1.0.0-rc1") \
            .getOrCreate()
from mmlspark.lightgbm import LightGBMClassifier
model = LightGBMClassifier(learningRate=0.3,
                           numIterations=100,
                           numLeaves=31).fit(train)
spark.stop()

Expected behavior from mmlspark.lightgbm import LightGBMClassifier should work

Info (please complete the following information):

• MMLSpark Version: from latest repo
• Spark Version 2.4.4
• Spark Platform: custom platform not on azure

** Stacktrace**

ModuleNotFoundError                       Traceback (most recent call last)
<ipython-input-9-1b16cbc5ea7e> in <module>
      5             .config("spark.jars.packages", "com.microsoft.ml.spark:mmlspark_2.11:1.0.0-rc1") \
      6             .getOrCreate()
----> 7 from mmlspark.lightgbm import LightGBMClassifier
      8 model = LightGBMClassifier(learningRate=0.3,
      9                            numIterations=100,

/mnt/user-home/git/mmlspark/src/main/python/mmlspark/lightgbm/LightGBMClassifier.py in <module>
      9     basestring = str
     10 
---> 11 from mmlspark.lightgbm._LightGBMClassifier import _LightGBMClassifier
     12 from mmlspark.lightgbm._LightGBMClassifier import _LightGBMClassificationModel
     13 from pyspark import SparkContext

ModuleNotFoundError: No module named 'mmlspark.lightgbm._LightGBMClassifier'

Additional context I tried this on Jupyter on a Linux machine. Does this only work on Azure?

[MarsXDM]

So is there any solutions for this problem?

[bkowshik]

Getting the same error as others on this thread. I was going through the LightGBM example here:

• 106 - Quantile Regression with LightGBM

from mmlspark.lightgbm import LightGBMRegressor
model = LightGBMRegressor(objective='quantile', alpha=0.2, learningRate=0.3, numLeaves=31).fit(train)

---------------------------------------------------------------------------
ModuleNotFoundError                       Traceback (most recent call last)
<ipython-input-25-064a17bb600b> in <module>
----> 1 from mmlspark.lightgbm import LightGBMRegressor
      2 model = LightGBMRegressor(objective='quantile', alpha=0.2, learningRate=0.3, numLeaves=31).fit(train)

/opt/conda/anaconda/lib/python3.7/site-packages/mmlspark/lightgbm/LightGBMRegressor.py in <module>
      9     basestring = str
     10 
---> 11 from mmlspark.lightgbm._LightGBMRegressor import _LightGBMRegressor
     12 from mmlspark.lightgbm._LightGBMRegressor import _LightGBMRegressionModel
     13 from pyspark import SparkContext

ModuleNotFoundError: No module named 'mmlspark.lightgbm._LightGBMRegressor'