Verbosity option is not working in GridSearchCV (Jupyter notebook)

Describe the bug

So this issue has been addressed before here by darrencl, but the user didn’t follow up with lesteve response.

The problem is that GridSearchCV doesn’t show the elapsed time periodically, or any log, I am setn_jobs = -1, and verbose = 1. I tried setting n_jobs to other values, the same with verbose, but nothing happened. Note that this didn’t happen until I updated scikit-learn from version 0.22.1 to 1.0.2.

lesteve in his response assumed that this problem is due to ipykernel <6, which is not the case with me.

Steps/Code to Reproduce

from sklearn.model_selection import GridSearchCV
from sklearn.ensemble import RandomForestClassifier
from sklearn import datasets

iris = datasets.load_iris()
params = {'n_estimators':[10,20,30,40,50,60],
          'max_depth':[20,50,60,70,80]}
grid_obj = GridSearchCV(estimator=RandomForestClassifier(), param_grid=params, n_jobs=-1, verbose=1, cv=5)
grid_obj.fit(iris.data, iris.target)

Expected Results

This is the output when using version 0.22.1

Actual Results

Fitting 5 folds for each of 30 candidates, totalling 150 fits

Versions

System:
    python: 3.8.5 (default, Sep  3 2020, 21:29:08) [MSC v.1916 64 bit (AMD64)]
executable: D:\Programs\ApplicationsSetup\anaconda3\python.exe
   machine: Windows-10-10.0.19041-SP0

Python dependencies:
          pip: 21.2.2
   setuptools: 58.0.4
      sklearn: 1.0.2
        numpy: 1.19.2
        scipy: 1.6.2
       Cython: 0.29.25
       pandas: 1.4.1
   matplotlib: 3.5.1
       joblib: 1.1.0
threadpoolctl: 2.2.0


!jupyter --version
Selected Jupyter core packages...
IPython          : 7.31.1
ipykernel        : 6.4.1
ipywidgets       : 7.6.5
jupyter_client   : 6.1.12
jupyter_core     : 4.9.1
jupyter_server   : 1.13.5
jupyterlab       : 3.2.9
nbclient         : 0.5.11
nbconvert        : 6.1.0
nbformat         : 5.1.3
notebook         : 6.4.9
qtconsole        : 5.2.2
traitlets        : 5.1.1

[NicerWang]

When I use:

from joblib import parallel_backend

grid_obj = GridSearchCV(... n_jobs=-1, verbose=3)

with parallel_backend('multiprocessing'):
    grid_obj.fit(x_text, y_test)

I can see verbose in terminal instead of notebook. I do not know why, but it works for me.

[jdambre]

Are there any updates on this? I have the same problem on Apple M1. I’m also teaching machine learning and I see that most of my students also have this problem. We set n_jobs=4 for them. No verbosity setting gives any output while running, but the output appears after the job is completed (often even in a different cell. It’s very annoying since it’s demotivating for the students if they don’t know how far along their gridsearch is