question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Tests fail with tensorflow 2.2.0 release candidates

See original GitHub issue

Describe the bug

In #1077, I pinned the version of tensorflow to the first 2.2.0 release candidate https://github.com/tensorflow/tensorflow/releases/tag/v2.2.0-rc0.

Some of our tests failed. https://buildkite.com/stellar/stellargraph-public/builds/2284

To Reproduce

Steps to reproduce the behavior:

  1. Install the tensorflow release candidate pip install tensorflow==2.2.0rc0
  2. Run test (e.g. pytest)

Observed behavior

4 tests fail:

FAILED tests/test_ensemble.py::test_compile - Failed: DID NOT RAISE <class 'V...
FAILED tests/reproducibility/test_graphsage.py::test_unsupervised[True] - Ass...
FAILED tests/reproducibility/test_graphsage.py::test_unsupervised[False] - As...
FAILED tests/reproducibility/test_graphsage.py::test_nai[True] - AssertionErr...

Expected behavior

No tests should fail.

Environment

Operating system: CI

Python version: 3.6.x and 3.7.x

Package versions:

absl-py==0.9.0
ansiwrap==0.8.4
appdirs==1.4.3
astunparse==1.6.3
attrs==19.3.0
backcall==0.1.0
black==19.10b0
bleach==3.1.1
boto==2.49.0
boto3==1.12.20
botocore==1.15.20
cachetools==4.0.0
certifi==2019.11.28
chardet==3.0.4
click==7.1.1
coverage==4.5.4
cycler==0.10.0
decorator==4.4.2
defusedxml==0.6.0
docopt==0.6.2
docutils==0.15.2
entrypoints==0.3
gast==0.3.3
gensim==3.8.1
google-auth==1.11.2
google-auth-oauthlib==0.4.1
google-pasta==0.1.8
grpcio==1.27.2
h5py==2.10.0
idna==2.9
importlib-metadata==1.5.0
ipykernel==5.1.4
ipython==7.13.0
ipython-genutils==0.2.0
ipywidgets==7.5.1
isodate==0.6.0
jedi==0.16.0
Jinja2==2.11.1
jmespath==0.9.5
joblib==0.14.1
jsonschema==3.2.0
jupyter==1.0.0
jupyter-client==6.0.0
jupyter-console==6.1.0
jupyter-core==4.6.3
Keras-Preprocessing==1.1.0
kiwisolver==1.1.0
llvmlite==0.31.0
Markdown==3.2.1
MarkupSafe==1.1.1
matplotlib==3.2.0
mistune==0.8.4
more-itertools==8.2.0
mplleaflet==0.0.5
nbclient==0.1.0
nbconvert==5.6.1
nbformat==5.0.4
networkx==2.4
notebook==6.0.3
numba==0.48.0
numpy==1.18.1
oauthlib==3.1.0
opt-einsum==3.2.0
packaging==20.3
pandas==1.0.1
pandocfilters==1.4.2
papermill==2.0.0
parso==0.6.2
pathspec==0.7.0
pexpect==4.8.0
pickleshare==0.7.5
pluggy==0.13.1
prometheus-client==0.7.1
prompt-toolkit==3.0.4
protobuf==3.11.3
ptyprocess==0.6.0
py==1.8.1
py-cpuinfo==5.0.0
pyasn1==0.4.8
pyasn1-modules==0.2.8
Pygments==2.6.1
pyparsing==2.4.6
pyrsistent==0.15.7
pytest==5.3.1
pytest-benchmark==3.2.3
pytest-cov==2.8.1
python-dateutil==2.8.1
pytz==2019.3
PyYAML==5.3
pyzmq==19.0.0
qtconsole==4.7.1
QtPy==1.9.0
rdflib==4.2.2
regex==2020.2.20
requests==2.23.0
requests-oauthlib==1.3.0
rsa==4.0
s3transfer==0.3.3
scikit-learn==0.22.2.post1
scipy==1.4.1
seaborn==0.10.0
Send2Trash==1.5.0
six==1.14.0
smart-open==1.9.0
tenacity==6.1.0
tensorboard==2.1.1
tensorflow==2.2.0rc0
tensorflow-estimator==2.1.0
termcolor==1.1.0
terminado==0.8.3
testpath==0.4.4
textwrap3==0.9.2
toml==0.10.0
tornado==6.0.4
tqdm==4.43.0
traitlets==4.3.3
treon==0.1.3
typed-ast==1.4.1
urllib3==1.25.8
wcwidth==0.1.8
webencodings==0.5.1
Werkzeug==1.0.0
widgetsnbextension==3.5.1
wrapt==1.12.1
zipp==3.1.0

Additional context

N/A

Issue Analytics

  • State:closed
  • Created 4 years ago
  • Comments:7 (7 by maintainers)

github_iconTop GitHub Comments

1reaction
kjun9commented, Mar 30, 2020

This seems to improve a lot (less failures) after upgrading from 2.2rc1 to 2.2rc2, I suspect it’s from this issue being resolved. There’s still some intermittent failures but it’s unclear how it compares to the flakiness prior to 2.2.

Running python -m pytest --count=300 tests/reproducibility/test_graphsage.py (using pytest-repeat)

Output:
============================= test session starts ==============================
platform darwin -- Python 3.7.5, pytest-5.3.1, py-1.8.1, pluggy-0.13.1
benchmark: 3.2.2 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /Users/jun021/work/stellar/stellargraph, inifile: pytest.ini
plugins: repeat-0.8.0, benchmark-3.2.2, cov-2.8.1
collected 1800 items

tests/reproducibility/test_graphsage.py ................................ [  1%]
........................................................................ [  5%]
........................................................................ [  9%]
........................................................................ [ 13%]
........................F............................................... [ 17%]
........................................................................ [ 21%]
........................................................................ [ 25%]
........................................................................ [ 29%]
........................................................................ [ 33%]
........................................................................ [ 37%]
........................................................................ [ 41%]
........................................................................ [ 45%]
........................................................................ [ 49%]
........................................................................ [ 53%]
........................................................................ [ 57%]
........................................................................ [ 61%]
....................................................................F... [ 65%]
........................................................................ [ 69%]
........................................................................ [ 73%]
........................................................................ [ 77%]
........................................................................ [ 81%]
........................................................................ [ 85%]
........................................................................ [ 89%]
........................................................................ [ 93%]
........................................................................ [ 97%]
........................................                                 [100%]

=================================== FAILURES ===================================
_______________________ test_unsupervised[True-273-300] ________________________

petersen_graph = <stellargraph.core.graph.StellarGraph object at 0x140047bd0>
shuffle = True

    @pytest.mark.parametrize("shuffle", [True, False])
    def test_unsupervised(petersen_graph, shuffle):
        assert_reproducible(
>           lambda: unsup_gs(
                petersen_graph,
                [2, 2],
                tf.optimizers.Adam(1e-3),
                epochs=4,
                walk_length=2,
                batch_size=4,
                shuffle=shuffle,
            )
        )

tests/reproducibility/test_graphsage.py:212: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

func = <function test_unsupervised.<locals>.<lambda> at 0x141869c20>
num_iter = 10

    def assert_reproducible(func, num_iter=10):
        """
        Assert Keras models produced from calling ``func`` are reproducible.
    
        Args:
            func (callable): Function to check for reproducible model
            num_iter (int): Number of iterations to run through to validate reproducibility.
    
        """
        model = func()
        for i in range(num_iter):
            model_new = func()
            assert models_equals(model, model_new), (
                model.get_weights(),
>               model_new.get_weights(),
            )
E           AssertionError: ([array([ 0.00623061,  0.00806176,  0.00267832, -0.00561015,  0.00372594,
E                   0.00892242,  0.        , -0.00134451, -0.01095336,  0.        ,
E                   0.00657242,  0.00542241,  0.00895842,  0.00455641,  0.011158  ,
E                   0.0004458 , -0.00978916, -0.00199516,  0.00843709, -0.01030695,
E                   0.        ,  0.01186865,  0.01337261,  0.0118678 ,  0.00488744,
E                  -0.00986822,  0.        , -0.00795464, -0.00746133,  0.        ,
E                   0.        ,  0.00760732,  0.00342201, -0.00922432,  0.00494049,
E                  -0.00974373,  0.        ,  0.00423221, -0.00971612,  0.        ,
E                   0.00552816,  0.0026735 , -0.00945645,  0.00256908,  0.        ,
E                  -0.008481  ,  0.00913319,  0.00932978, -0.00565406,  0.        ],
E                 dtype=float32), array([[-1.64424449e-01, -2.36992612e-01,  3.19461003e-02,
E                    4.07698005e-02, -6.51341304e-02,  2.57711172e-01,
E                   -5.61013818e-03,  4.16672289e-01,  1.49127483e-01,
E                   -3.10220122e-01,  1.80762857e-01,  1.39362723e-01,
E                    6.86953962e-02, -1.07439011e-01, -5.32479174e-02,
E                    1.15840450e-01,  3.35615605e-01,  1.31862909e-01,
E                    2.82535613e-01, -3.55080277e-01, -1.82376534e-01,
E                   -3.88637453e-01,  1.99164346e-01,  2.31760547e-01,
E                    1.53206199e-01],
E                  [ 3.38514261e-02,  2.19697356e-01, -3.72156292e-01,
E                   -3.79215032e-01,  2.16201037e-01, -2.71044672e-01,
E                   -1.55732453e-01, -1.72601014e-01, -3.44765961e-01,
E                   -2.76850939e-01,  2.29988128e-01,  7.82575533e-02,
E                    4.07775193e-01,  3.48070413e-01, -2.83819556e-01,
E                   -3.26788157e-01,  7.80984759e-02, -2.68700212e-01,
E                    2.05004700e-02,  3.94971997e-01, -2.68480122e-01,
E                   -3.63904893e-01,  9.28781033e-02,  6.23405576e-02,
E                    2.56131709e-01],
E                  [ 7.52175599e-02, -3.31839710e-01,  3.71093541e-01,
E                   -1.89592510e-01,  4.53223772e-02, -1.74281672e-01,
E                   -3.48203063e-01, -8.69309157e-02, -3.63076568e-01,
E                   -3.79314393e-01,  3.57164830e-01,  3.14200789e-01,
E                   -1.76734533e-02, -2.03570779e-02,  1.17059186e-01,
E                    1.94832370e-01,  3.55271101e-01, -1.19751841e-01,
E                   -2.40196288e-01,  7.35611245e-02, -8.13500583e-02,
E                    8.34059343e-02,  3.18984419e-01,  2.76243001e-01,
E                   -4.06876117e-01],
E                  [-2.07290769e-01, -2.36540526e-01, -3.78077120e-01,
E                    3.92454028e-01, -2.67587960e-01,  1.67900532e-01,
E                    1.96029454e-01,  2.82698393e-01,  1.80261329e-01,
E                    1.91392273e-01, -2.51543671e-01,  1.99029192e-01,
E                   -2.49004170e-01,  7.31924027e-02, -3.72279644e-01,
E                    1.49273410e-01,  6.09066747e-02, -4.15283889e-01,
E                   -1.60086136e-02,  3.76675814e-01,  1.93115145e-01,
E                    8.87382552e-02, -1.21719539e-01,  2.29187861e-01,
E                   -3.59905541e-01],
E                  [ 1.42091021e-01, -1.70279443e-02, -3.55638027e-01,
E                    3.82284194e-01, -2.80617028e-02,  4.78016213e-03,
E                   -3.20468605e-01,  1.91075474e-01,  1.99329883e-01,
E                   -5.59806824e-02, -3.69609714e-01,  3.77867408e-02,
E                   -2.71500558e-01, -8.14380497e-02,  6.52278960e-02,
E                   -3.35027426e-01,  3.64192843e-01, -1.56328037e-01,
E                   -1.85268689e-02,  6.73523396e-02, -3.32979500e-01,
E                   -1.58511475e-01, -2.25199521e-01,  1.47937119e-01,
E                   -1.81346610e-01],
E                  [ 3.31369609e-01,  2.15869650e-01,  1.16289802e-01,
E                    1.96288824e-01,  1.75578758e-01, -8.94524157e-02,
E                    4.12735730e-01,  1.01761371e-01, -9.33214203e-02,
E                    1.78578764e-01, -3.27451915e-01, -1.05579272e-01,
E                   -1.36786655e-01, -6.29673675e-02,  9.68727469e-02,
E                    1.48916364e-01,  1.10106073e-01,  3.32918763e-01,
E                   -3.71555895e-01, -2.73028146e-02, -2.83780992e-02,
E                   -1.22827291e-01, -3.03305209e-01, -1.91473186e-01,
E                    2.37896433e-03],
E                  [-3.62577856e-01, -5.99944293e-02, -2.31586114e-01,
E                   -1.99974641e-01, -1.88829582e-02,  3.57042372e-01,
E                   -3.99917036e-01, -2.41004646e-01,  1.52934521e-01,
E                    1.78287596e-01, -2.74591446e-01, -3.21939379e-01,
E                   -3.68455857e-01,  7.43743107e-02,  1.05199605e-01,
E                    3.46175641e-01,  1.55439436e-01, -2.22829282e-01,
E                    2.53693312e-01,  2.32612446e-01,  6.59555197e-02,
E                    9.02012736e-02, -2.14981318e-01, -2.27045923e-01,
E                   -2.67632306e-01],
E                  [ 3.84257764e-01,  1.10714465e-01,  3.16776663e-01,
E                    1.11847952e-01,  2.50197917e-01, -1.77555770e-01,
E                    1.99431092e-01, -3.44293892e-01,  2.19103657e-02,
E                   -5.64507842e-02,  7.16561824e-02,  2.69688606e-01,
E                    2.28373542e-01, -4.75809164e-02, -3.77452880e-01,
E                    3.50424260e-01,  8.04109499e-02, -7.57423118e-02,
E                    2.48699680e-01,  2.17656851e-01, -1.54200405e-01,
E                    4.06716079e-01,  1.66274428e-01, -3.52735341e-01,
E                   -2.57934034e-01],
E                  [ 8.35067332e-02, -2.47866493e-02,  5.68895936e-02,
E                   -3.12110901e-01, -2.81176358e-01,  2.32163712e-01,
E                   -3.71592522e-01,  9.97310802e-02,  1.33264646e-01,
E                   -3.87157083e-01, -2.97920704e-01, -1.14631668e-01,
E                   -3.22772473e-01, -2.13687301e-01, -7.63914436e-02,
E                   -3.00247222e-01,  3.38306904e-01,  1.24193288e-01,
E                    1.78291291e-01,  3.38516951e-01,  6.59203827e-02,
E                    3.48487645e-01, -1.76893249e-01, -4.20119762e-02,
E                    3.88372391e-01],
E                  [-2.71788508e-01,  4.06308413e-01, -2.79548079e-01,
E                    1.68329954e-01,  1.88175261e-01,  2.65652478e-01,
E                   -2.31080577e-01,  8.56985375e-02,  2.35905290e-01,
E                   -8.71999860e-02,  1.05187945e-01, -3.27300370e-01,
E                    2.59625167e-01, -2.00758576e-01,  2.88017064e-01,
E                    1.27378181e-01,  2.95380414e-01,  3.85027528e-01,
E                   -3.20721418e-01,  2.47515651e-04, -2.56072074e-01,
E                    1.84087396e-01,  1.97705030e-01, -1.47159934e-01,
E                    3.84775072e-01]], dtype=float32), array([[ 0.03664558, -0.23079135,  0.29528257,  0.2264204 ,  0.12016806,
E                    0.02514234, -0.39700365,  0.31291556, -0.03474812, -0.09001748,
E                    0.31149408,  0.11327222, -0.40992692,  0.28615478, -0.3247067 ,
E                    0.38516194, -0.23626818,  0.12316744, -0.3200223 , -0.29049852,
E                    0.39612895,  0.2967324 , -0.35229948,  0.12489365, -0.03186706],
E                  [ 0.3899665 ,  0.32294932,  0.20967093,  0.20140007, -0.16883604,
E                   -0.03394955,  0.15353271, -0.19807069,  0.11972332,  0.23961186,
E                    0.3971933 , -0.23505484, -0.39560494, -0.01124827, -0.33309016,
E                    0.39368224,  0.2978603 ,  0.28964534, -0.02618811,  0.02013454,
E                    0.1493298 ,  0.08068199,  0.19578014, -0.3768517 , -0.2205573 ],
E                  [ 0.39547005, -0.29495302,  0.32038328,  0.22552443, -0.20084418,
E                   -0.40165955,  0.25128368, -0.00186012,  0.16684622, -0.02030804,
E                    0.19295733, -0.14431375, -0.05136619, -0.2396755 ,  0.09680733,
E                   -0.2937522 , -0.11404481,  0.4049941 ,  0.28366435, -0.375894  ,
E                   -0.31397137, -0.1589697 ,  0.06338327, -0.35225248, -0.15724063],
E                  [ 0.22097048,  0.05870414,  0.2005484 ,  0.20669597, -0.18394384,
E                   -0.3601889 , -0.3080603 , -0.30453846, -0.38830793, -0.20108789,
E                   -0.30627123, -0.13833264,  0.16439281,  0.01466129,  0.18405727,
E                    0.25173876, -0.23112719, -0.2896531 ,  0.345648  , -0.26601976,
E                    0.17868474, -0.13858055,  0.18513678, -0.25826594, -0.3895514 ],
E                  [ 0.12070008,  0.08545375,  0.24530071,  0.34359878,  0.03284898,
E                    0.35378507, -0.31067082,  0.32430533,  0.10165317,  0.18145864,
E                   -0.4168784 , -0.21877708,  0.3189645 , -0.27101752, -0.32412982,
E                    0.09426026,  0.3447744 , -0.30720732, -0.2223736 ,  0.317557  ,
E                   -0.13004433, -0.23303849, -0.30860424,  0.09912133, -0.24894024],
E                  [ 0.21961698, -0.33500987,  0.04414432,  0.28633386, -0.32204545,
E                   -0.23150219,  0.3149384 ,  0.10162506, -0.09831814,  0.16619574,
E                    0.15318725, -0.20634387, -0.18719104, -0.31171602, -0.36638078,
E                    0.27495328, -0.18481548, -0.20915869,  0.3144246 ,  0.11598942,
E                   -0.09980824,  0.3365356 , -0.0512681 , -0.12700129, -0.34307683],
E                  [ 0.38972768, -0.4038495 ,  0.30508596,  0.1037225 , -0.2957316 ,
E                   -0.2984949 ,  0.4046887 , -0.36243853,  0.36754027, -0.13453712,
E                   -0.09531029,  0.26299444, -0.20580517,  0.18632008,  0.02302805,
E                   -0.18494134,  0.04531327, -0.08121434,  0.39982423, -0.05481696,
E                    0.17174934, -0.21429108, -0.04258506,  0.34432366,  0.01433387],
E                  [ 0.36421838,  0.16674802, -0.41086754, -0.18833606,  0.04556412,
E                   -0.1495311 , -0.04429583, -0.14657965, -0.03099461,  0.07004815,
E                    0.11276737, -0.01833811,  0.2515024 , -0.05244133,  0.11738428,
E                   -0.22931398, -0.08728945, -0.11140098,  0.09040873, -0.01454926,
E                   -0.4142343 , -0.39482293,  0.37159956,  0.39702064,  0.28209522],
E                  [ 0.26438835,  0.06580824,  0.33974537, -0.16905816, -0.3284728 ,
E                   -0.16723628, -0.33180746,  0.05342835,  0.32733944,  0.21316099,
E                    0.33015558, -0.32766718, -0.10723527,  0.2118213 , -0.316657  ,
E                    0.03170079, -0.0053606 ,  0.19711791, -0.21598801,  0.10032353,
E                    0.23008247,  0.3953902 , -0.28659672, -0.16069894, -0.35116145],
E                  [ 0.34962916, -0.38653743, -0.40824056, -0.09399075, -0.0935902 ,
E                   -0.26437843, -0.37357444, -0.34941253,  0.30396652, -0.4088734 ,
E                    0.03433849, -0.38052553,  0.28994697, -0.12201767,  0.1828616 ,
E                   -0.29148194, -0.10971306,  0.38752174,  0.22707993, -0.06953579,
E                    0.27076414,  0.16682506,  0.00427055,  0.35035914,  0.24063191]],
E                 dtype=float32), array([ 0.00772877,  0.00875321, -0.00864642,  0.01031941, -0.01102743,
E                  -0.01034084,  0.01110959, -0.00974833,  0.00048017,  0.00316836,
E                  -0.00795747,  0.00896566,  0.0104302 ,  0.00991522,  0.00691186,
E                  -0.00857474,  0.00944508, -0.00928035, -0.00156894, -0.00434994,
E                   0.00910927, -0.00922325, -0.00738607,  0.00278931, -0.01022295,
E                  -0.00953271,  0.01029107,  0.00899747, -0.0095732 , -0.0075753 ,
E                  -0.00684376, -0.01169875,  0.01113878,  0.0095929 ,  0.0099099 ,
E                  -0.00939281, -0.00252932, -0.00373492,  0.00930529, -0.00960621,
E                  -0.00554469, -0.00532803,  0.00905223,  0.0044186 , -0.00871672,
E                   0.00967048,  0.00695148, -0.00923831,  0.00885148,  0.00395413],
E                 dtype=float32), array([[-0.17189927,  0.1417248 , -0.01658153, ..., -0.03199666,
E                    0.1414772 , -0.18910259],
E                  [-0.15020601,  0.27501708,  0.28216285, ...,  0.01225806,
E                    0.09994171,  0.07798553],
E                  [ 0.09472486,  0.12993328,  0.21776465, ...,  0.09761394,
E                    0.07129578,  0.215525  ],
E                  ...,
E                  [ 0.00423131,  0.08250799,  0.22152142, ..., -0.24182206,
E                    0.21429884,  0.13908954],
E                  [ 0.08526509,  0.11604113, -0.17820807, ...,  0.25687316,
E                   -0.26998955,  0.04932202],
E                  [-0.0734455 , -0.23041427,  0.04146096, ...,  0.23699793,
E                   -0.2696884 , -0.09890059]], dtype=float32), array([[-1.88736245e-01, -1.06731057e-01,  2.07391724e-01, ...,
E                    1.10626899e-01,  7.62071684e-02,  1.40553787e-01],
E                  [ 9.66263711e-02,  1.13044247e-01,  1.61099151e-01, ...,
E                    2.13975191e-01, -8.87290463e-02,  1.74167275e-01],
E                  [ 2.55919546e-01, -6.40875176e-02, -1.95390642e-01, ...,
E                   -2.53528684e-01,  2.61533082e-01,  2.06118554e-01],
E                  ...,
E                  [ 1.96037278e-01,  1.41036958e-01, -7.90518746e-02, ...,
E                    6.14204668e-02,  1.77475750e-01, -5.78654818e-02],
E                  [ 6.44274405e-05,  2.11342484e-01,  6.64627403e-02, ...,
E                    4.35001142e-02,  2.39748284e-01, -1.36543840e-01],
E                  [-8.77967477e-02,  1.04591072e-01,  1.24932498e-01, ...,
E                    5.49465418e-02,  1.13674104e-01,  1.33549482e-01]], dtype=float32)], [array([ 0.00635608,  0.00711126,  0.0030422 , -0.00584703,  0.00433236,
E                   0.00742345,  0.        , -0.00105109, -0.00718512,  0.        ,
E                   0.00592306,  0.00618754,  0.01019536,  0.00256921,  0.00961875,
E                   0.00048013, -0.00781763, -0.0023198 ,  0.00920091, -0.00914112,
E                   0.        ,  0.01082853,  0.01302299,  0.01141074,  0.00422337,
E                  -0.00821737,  0.        , -0.00563748, -0.0059159 ,  0.        ,
E                   0.        ,  0.00519895,  0.00477549, -0.00768144,  0.00429243,
E                  -0.00854446,  0.        ,  0.00317463, -0.00960911,  0.        ,
E                   0.00472138,  0.0013915 , -0.00729017,  0.00608343,  0.        ,
E                  -0.00730755,  0.00805964,  0.01258198, -0.005718  ,  0.        ],
E                 dtype=float32), array([[-0.16488916, -0.23836653,  0.03231008,  0.03955215, -0.06639986,
E                    0.25491947, -0.00561014,  0.41578996,  0.15044436, -0.31022012,
E                    0.17983595,  0.13897906,  0.06979149, -0.10942555, -0.05526812,
E                    0.11561322,  0.33679637,  0.13153839,  0.28152058, -0.3537269 ,
E                   -0.18237653, -0.38892952,  0.19907564,  0.23047243,  0.15204526],
E                  [ 0.03384535,  0.21753281, -0.37179223, -0.38008758,  0.21598466,
E                   -0.27460393, -0.15573245, -0.1713234 , -0.3425196 , -0.27685094,
E                    0.2293631 ,  0.07748564,  0.4087355 ,  0.34608334, -0.2859935 ,
E                   -0.32562754,  0.08039209, -0.2690248 ,  0.02069706,  0.38924634,
E                   -0.26848012, -0.36464962,  0.09318207,  0.06301893,  0.25533232],
E                  [ 0.07520707, -0.3328635 ,  0.37145746, -0.19173184,  0.04663099,
E                   -0.17829923, -0.34820306, -0.08830725, -0.36175483, -0.3793144 ,
E                    0.35632706,  0.3149724 , -0.01631202, -0.02234222,  0.11548215,
E                    0.19484647,  0.35537282, -0.12007642, -0.23874398,  0.07641602,
E                   -0.08135006,  0.08265223,  0.31755233,  0.27418005, -0.40820816],
E                  [-0.2075583 , -0.23770407, -0.37771204,  0.39279836, -0.2683888 ,
E                    0.16642614,  0.19602945,  0.28310263,  0.18233678,  0.19139227,
E                   -0.25240234,  0.19829646, -0.24766353,  0.07120533, -0.37341392,
E                    0.1483752 ,  0.06262757, -0.41560733, -0.01701762,  0.37476963,
E                    0.19311514,  0.08795901, -0.1213247 ,  0.22910663, -0.36074162],
E                  [ 0.14165604, -0.01641817, -0.3552736 ,  0.3835493 , -0.02829847,
E                    0.00433373, -0.3204686 ,  0.19013733,  0.2055132 , -0.05598068,
E                   -0.37142602,  0.03720988, -0.27060494, -0.08342449,  0.06307637,
E                   -0.33662632,  0.3650857 , -0.15665263, -0.01740576,  0.06851758,
E                   -0.3329795 , -0.16100863, -0.22701314,  0.14584936, -0.18107113],
E                  [ 0.33147708,  0.21424471,  0.11665437,  0.19499925,  0.17509867,
E                   -0.08992293,  0.41273573,  0.10424183, -0.09042679,  0.17857876,
E                   -0.32755977, -0.10637085, -0.13654071, -0.06495319,  0.09496242,
E                    0.15130307,  0.11159239,  0.33259413, -0.3714773 , -0.02818574,
E                   -0.0283781 , -0.12433605, -0.30106562, -0.18968089,  0.00212077],
E                  [-0.36229855, -0.06139147, -0.23122217, -0.19789574, -0.0158552 ,
E                    0.35629308, -0.39991704, -0.24140082,  0.15796666,  0.1782876 ,
E                   -0.275142  , -0.3225374 , -0.3682016 ,  0.0723873 ,  0.10420567,
E                    0.34616566,  0.15688682, -0.22315364,  0.25523773,  0.2317935 ,
E                    0.06595552,  0.08833326, -0.21773413, -0.22696854, -0.26756912],
E                  [ 0.3836077 ,  0.10750084,  0.31714094,  0.1099428 ,  0.24883638,
E                   -0.1806603 ,  0.19943109, -0.34191674,  0.0219366 , -0.05645078,
E                    0.07160702,  0.26877752,  0.22952749, -0.04955305, -0.37916896,
E                    0.35285348,  0.08092421, -0.07606646,  0.24750955,  0.2157196 ,
E                   -0.1542004 ,  0.40641204,  0.16740155, -0.35156238, -0.25925317],
E                  [ 0.08316676, -0.02699756,  0.05725363, -0.31233537, -0.2803701 ,
E                    0.23073424, -0.37159252,  0.10123292,  0.13541381, -0.38715708,
E                   -0.29815638, -0.11505201, -0.3213153 , -0.21567446, -0.07748039,
E                   -0.29822293,  0.33988887,  0.12386882,  0.17901322,  0.33629814,
E                    0.06592038,  0.34759954, -0.17671096, -0.04140778,  0.3875412 ],
E                  [-0.2710062 ,  0.40570325, -0.27918375,  0.1688334 ,  0.1898693 ,
E                    0.26610476, -0.23108058,  0.08671392,  0.23675422, -0.08719999,
E                    0.10513948, -0.32556933,  0.26120037, -0.20268182,  0.28584892,
E                    0.12685765,  0.29651666,  0.38470307, -0.32054788, -0.00201312,
E                   -0.25607207,  0.18336536,  0.1982428 , -0.14770119,  0.3842194 ]],
E                 dtype=float32), array([[ 0.03838487, -0.23079135,  0.295989  ,  0.22452122,  0.12016806,
E                    0.02514234, -0.39916915,  0.31435004, -0.03363179, -0.08977478,
E                    0.31290713,  0.11327222, -0.41071197,  0.28585705, -0.3247067 ,
E                    0.38489303, -0.23760736,  0.12604798, -0.32273844, -0.29049852,
E                    0.39612743,  0.29253897, -0.35011575,  0.1247047 , -0.03186706],
E                  [ 0.39020312,  0.32294932,  0.21155694,  0.20360008, -0.16883604,
E                   -0.03394955,  0.15048009, -0.19670923,  0.1211618 ,  0.2388565 ,
E                    0.3982407 , -0.23505484, -0.39661175, -0.01080271, -0.33309016,
E                    0.39128846,  0.29682383,  0.29158568, -0.02825508,  0.02013454,
E                    0.14654477,  0.0800272 ,  0.19830164, -0.3768789 , -0.2205573 ],
E                  [ 0.39775681, -0.29495302,  0.32127395,  0.22288229, -0.20084418,
E                   -0.40165955,  0.24910681, -0.00047008,  0.16811526, -0.01949215,
E                    0.19346666, -0.14431375, -0.05148969, -0.24011941,  0.09680733,
E                   -0.29125026, -0.11581489,  0.40514526,  0.2846398 , -0.375894  ,
E                   -0.31233734, -0.16012938,  0.06685364, -0.3529303 , -0.15724063],
E                  [ 0.22013451,  0.05870414,  0.20128441,  0.20819895, -0.18394384,
E                   -0.3601889 , -0.3098647 , -0.3030611 , -0.38760614, -0.20344856,
E                   -0.30471328, -0.13833264,  0.16339684,  0.01484079,  0.18405727,
E                    0.24923913, -0.23092546, -0.28777352,  0.34318978, -0.26601976,
E                    0.17583515, -0.13962477,  0.1886807 , -0.25841185, -0.3895514 ],
E                  [ 0.12297365,  0.08545375,  0.25146726,  0.34262225,  0.03284898,
E                    0.35378507, -0.31489897,  0.32567105,  0.10153627,  0.18190166,
E                   -0.41659865, -0.21877708,  0.3177651 , -0.27172458, -0.32412982,
E                    0.09863216,  0.3431763 , -0.3059019 , -0.22180769,  0.317557  ,
E                   -0.1279125 , -0.23356637, -0.3079345 ,  0.09926714, -0.24894024],
E                  [ 0.22195858, -0.33500987,  0.04672581,  0.28807476, -0.32204545,
E                   -0.23150219,  0.31142163,  0.10269605, -0.09615952,  0.16739582,
E                    0.15433232, -0.20634387, -0.18836063, -0.3104741 , -0.36638078,
E                    0.2737982 , -0.18652168, -0.20710534,  0.31686372,  0.11598942,
E                   -0.09982999,  0.33419955, -0.05018815, -0.12670308, -0.34307683],
E                  [ 0.3899438 , -0.4038495 ,  0.3078774 ,  0.10694285, -0.2957316 ,
E                   -0.2984949 ,  0.40319937, -0.3610536 ,  0.3699686 , -0.13657561,
E                   -0.09525441,  0.26299444, -0.2070161 ,  0.18676151,  0.02302805,
E                   -0.1872875 ,  0.04470456, -0.08142788,  0.40314806, -0.05481696,
E                    0.17274377, -0.212904  , -0.03999421,  0.34450737,  0.01433387],
E                  [ 0.36411494,  0.16674802, -0.41161385, -0.1882358 ,  0.04556412,
E                   -0.1495311 , -0.04613087, -0.14523847, -0.02869224,  0.07126787,
E                    0.11347459, -0.01833811,  0.25137922, -0.05203836,  0.11738428,
E                   -0.23198007, -0.08907928, -0.10814394,  0.08662932, -0.01454926,
E                   -0.41652498, -0.39868647,  0.37422845,  0.39649934,  0.28209522],
E                  [ 0.263918  ,  0.06580824,  0.34085715, -0.16728877, -0.3284728 ,
E                   -0.16723628, -0.33362427,  0.05477266,  0.32863826,  0.21128157,
E                    0.33050936, -0.32766718, -0.10822852,  0.21226265, -0.316657  ,
E                    0.02874295, -0.00601333,  0.19754781, -0.2162371 ,  0.10032353,
E                    0.2282975 ,  0.39564618, -0.28245294, -0.16093808, -0.35116145],
E                  [ 0.35118032, -0.38653743, -0.40802103, -0.09180918, -0.0935902 ,
E                   -0.26437843, -0.3772315 , -0.3482195 ,  0.3041245 , -0.40902755,
E                    0.03645355, -0.38052553,  0.288878  , -0.12243293,  0.1828616 ,
E                   -0.29072836, -0.11164419,  0.39067173,  0.22470307, -0.06953579,
E                    0.2698175 ,  0.16362129,  0.00976441,  0.35025114,  0.24063191]],
E                 dtype=float32), array([ 0.00692013,  0.00581301, -0.00808759,  0.00978886, -0.00914953,
E                  -0.01155481,  0.00828667, -0.00849386, -0.00174645, -0.00074874,
E                  -0.01035339,  0.0073715 ,  0.00883099,  0.00791491,  0.00425863,
E                  -0.00747366,  0.00719484, -0.00730182,  0.00249947, -0.00474763,
E                   0.00830297, -0.00649133, -0.00638312, -0.00113664, -0.00825347,
E                  -0.00779558,  0.01127165,  0.00746124, -0.00889409, -0.00577984,
E                  -0.0048219 , -0.01156463,  0.01041508,  0.00774011,  0.00817628,
E                  -0.0078092 , -0.00045015, -0.00449359,  0.00616015, -0.00724737,
E                  -0.00245453, -0.0072211 ,  0.00858886,  0.00551545, -0.00746824,
E                   0.00809966,  0.00537257, -0.00731388,  0.00849088,  0.00555   ],
E                 dtype=float32), array([[-0.16904555,  0.14256124, -0.01425203, ..., -0.03517081,
E                    0.14323457, -0.18807189],
E                  [-0.15437809,  0.27356148,  0.28130868, ...,  0.01207902,
E                    0.09770483,  0.08076746],
E                  [ 0.09630884,  0.12972926,  0.21751337, ...,  0.09734692,
E                    0.07051467,  0.21445057],
E                  ...,
E                  [ 0.00396605,  0.08681112,  0.2225073 , ..., -0.24225122,
E                    0.2180959 ,  0.13599913],
E                  [ 0.08459812,  0.11508185, -0.1790524 , ...,  0.25581107,
E                   -0.27130094,  0.04917547],
E                  [-0.0734455 , -0.23041427,  0.04146096, ...,  0.23699793,
E                   -0.2696884 , -0.09890059]], dtype=float32), array([[-0.18583906, -0.10819658,  0.20797716, ...,  0.10918948,
E                    0.07563058,  0.1383773 ],
E                  [ 0.09615702,  0.11141802,  0.16186646, ...,  0.21384136,
E                   -0.08817869,  0.1728324 ],
E                  [ 0.25825548, -0.06610721, -0.19525139, ..., -0.25440422,
E                    0.25941092,  0.2067423 ],
E                  ...,
E                  [ 0.1960243 ,  0.14443465, -0.08356061, ...,  0.0685024 ,
E                    0.18124512, -0.05717653],
E                  [ 0.00317994,  0.21068865,  0.06459501, ...,  0.04497061,
E                    0.23817031, -0.13639311],
E                  [-0.08779675,  0.10459107,  0.1249325 , ...,  0.05494654,
E                    0.1136741 ,  0.13354948]], dtype=float32)])

tests/reproducibility/fixtures.py:41: AssertionError
----------------------------- Captured stdout call -----------------------------
link_classification: using 'ip' method to combine node embeddings into edge embeddings
Epoch 1/4

1/5 [=====>........................] - ETA: 0s - loss: 0.5708
5/5 [==============================] - 0s 2ms/step - loss: 0.7991
Epoch 2/4

1/5 [=====>........................] - ETA: 0s - loss: 0.7869
5/5 [==============================] - 0s 2ms/step - loss: 0.7996
Epoch 3/4

1/5 [=====>........................] - ETA: 0s - loss: 0.8082
5/5 [==============================] - 0s 2ms/step - loss: 0.7939
Epoch 4/4

1/5 [=====>........................] - ETA: 0s - loss: 0.7747
5/5 [==============================] - 0s 2ms/step - loss: 0.7946
link_classification: using 'ip' method to combine node embeddings into edge embeddings
Epoch 1/4

1/5 [=====>........................] - ETA: 0s - loss: 0.5708
5/5 [==============================] - 0s 1ms/step - loss: 0.7991
Epoch 2/4

1/5 [=====>........................] - ETA: 0s - loss: 0.7869
5/5 [==============================] - 0s 1ms/step - loss: 0.7996
Epoch 3/4

1/5 [=====>........................] - ETA: 0s - loss: 0.8082
5/5 [==============================] - 0s 1ms/step - loss: 0.7939
Epoch 4/4

1/5 [=====>........................] - ETA: 0s - loss: 0.7747
5/5 [==============================] - 0s 1ms/step - loss: 0.7946
link_classification: using 'ip' method to combine node embeddings into edge embeddings
Epoch 1/4

1/5 [=====>........................] - ETA: 0s - loss: 0.5708
5/5 [==============================] - 0s 2ms/step - loss: 0.7991
Epoch 2/4

1/5 [=====>........................] - ETA: 0s - loss: 0.7869
2/5 [===========>..................] - ETA: 0s - loss: 0.9147
5/5 [==============================] - 0s 19ms/step - loss: 0.7996
Epoch 3/4

1/5 [=====>........................] - ETA: 0s - loss: 0.8007
5/5 [==============================] - 0s 2ms/step - loss: 0.8054
Epoch 4/4

1/5 [=====>........................] - ETA: 0s - loss: 0.3464
5/5 [==============================] - 0s 2ms/step - loss: 0.7944
___________________________ test_nai[False-281-300] ____________________________

petersen_graph = <stellargraph.core.graph.StellarGraph object at 0x13ff98810>
shuffle = False

    @pytest.mark.parametrize("shuffle", [True, False])
    def test_nai(petersen_graph, shuffle):
        target_size = 10
        targets = np.random.rand(len(petersen_graph.nodes()), target_size)
        assert_reproducible(
>           lambda: gs_nai(
                petersen_graph, targets, [2, 2], tf.optimizers.Adam(1e-3), shuffle=shuffle
            )
        )

tests/reproducibility/test_graphsage.py:229: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

func = <function test_nai.<locals>.<lambda> at 0x1428becb0>, num_iter = 10

    def assert_reproducible(func, num_iter=10):
        """
        Assert Keras models produced from calling ``func`` are reproducible.
    
        Args:
            func (callable): Function to check for reproducible model
            num_iter (int): Number of iterations to run through to validate reproducibility.
    
        """
        model = func()
        for i in range(num_iter):
            model_new = func()
            assert models_equals(model, model_new), (
                model.get_weights(),
>               model_new.get_weights(),
            )
E           AssertionError: ([array([ 0.00636744, -0.00966135,  0.0064503 ,  0.00792544,  0.00431308,
E                   0.01200567,  0.        , -0.0109778 , -0.01006021,  0.        ,
E                   0.01051244,  0.01077931, -0.00792994,  0.00329707,  0.00807588,
E                   0.01079916, -0.01196575, -0.00354123,  0.01017802, -0.01188231,
E                   0.        ,  0.01040664, -0.01051376,  0.00536426,  0.01049285,
E                  -0.00904355,  0.        ,  0.01161325, -0.01025783,  0.        ,
E                   0.        ,  0.00408577,  0.00499609,  0.01062843, -0.0080355 ,
E                  -0.01056868,  0.        , -0.00410698,  0.01162565,  0.        ,
E                  -0.00754214,  0.00798118,  0.01167774, -0.00812069,  0.        ,
E                   0.0118078 ,  0.00374114,  0.00741124, -0.00650206,  0.        ],
E                 dtype=float32), array([[-0.16655634, -0.2526778 ,  0.03584746,  0.05906722, -0.0641052 ,
E                    0.2668659 , -0.00561014,  0.40190414,  0.15575542, -0.31022012,
E                    0.18431264,  0.14505556,  0.05196297, -0.1086982 , -0.05683925,
E                    0.11670612,  0.33081037,  0.13031627,  0.28659928, -0.35614103,
E                   -0.18237653, -0.3928539 ,  0.17701264,  0.22283183,  0.15913327],
E                  [ 0.03298   ,  0.20399453, -0.36823526, -0.36387867,  0.21276876,
E                   -0.25919887, -0.15573245, -0.18386342, -0.3397494 , -0.27685094,
E                    0.23390412,  0.08147957,  0.391321  ,  0.34681106, -0.2875059 ,
E                   -0.32342076,  0.0763341 , -0.27024665,  0.02249433,  0.38730693,
E                   -0.26848012, -0.36638492,  0.07027639,  0.05762934,  0.26294374],
E                  [ 0.07620262, -0.33649746,  0.37493238, -0.17246129,  0.04777547,
E                   -0.17070927, -0.34820306, -0.10197753, -0.36237466, -0.3793144 ,
E                    0.36124614,  0.32144105, -0.03452263, -0.02161604,  0.11393197,
E                    0.20141527,  0.3489546 , -0.12129802, -0.2320722 ,  0.07364838,
E                   -0.08135006,  0.08262027,  0.29544723,  0.2664121 , -0.39695552],
E                  [-0.20919186, -0.25447333, -0.3740289 ,  0.40436357, -0.26870707,
E                    0.17562133,  0.19602945,  0.2732271 ,  0.18570575,  0.19139227,
E                   -0.24817343,  0.20590018, -0.26590726,  0.07193309, -0.37473336,
E                    0.15148662,  0.05986045, -0.41683483, -0.01177709,  0.36353415,
E                    0.19311514,  0.08521906, -0.14192726,  0.22743313, -0.3546081 ],
E                  [ 0.14502835, -0.02925013, -0.35168234,  0.39580488, -0.02671346,
E                    0.01253633, -0.3204686 ,  0.18039098,  0.20479731, -0.05598068,
E                   -0.36517715,  0.04190437, -0.28737867, -0.08269726,  0.06152513,
E                   -0.3252704 ,  0.35892934, -0.15787429, -0.01659305,  0.06172191,
E                   -0.3329795 , -0.15956986, -0.23868527,  0.1397307 , -0.1783168 ],
E                  [ 0.33158752,  0.20465983,  0.12004653,  0.2087549 ,  0.17256013,
E                   -0.07588657,  0.41273573,  0.09204282, -0.09305453,  0.17857876,
E                   -0.32205257, -0.10290738, -0.15080331, -0.06422648,  0.09337547,
E                    0.16060102,  0.10785434,  0.3313725 , -0.37076318, -0.04246595,
E                   -0.0283781 , -0.12309934, -0.32113677, -0.18943223,  0.00893806],
E                  [-0.3608659 , -0.0772436 , -0.2278389 , -0.19167152, -0.02022044,
E                    0.36030054, -0.39991704, -0.2491965 ,  0.14789036,  0.1782876 ,
E                   -0.26905605, -0.31489655, -0.38216203,  0.07311501,  0.10296832,
E                    0.36425984,  0.15352468, -0.22437654,  0.25432122,  0.23218751,
E                    0.06595552,  0.09129776, -0.23539253, -0.23196822, -0.26210278],
E                  [ 0.38266137,  0.10392094,  0.32078514,  0.1249043 ,  0.24761663,
E                   -0.16486329,  0.19943109, -0.35967204,  0.02038586, -0.05645078,
E                    0.07677084,  0.27370074,  0.21156648, -0.04883615, -0.3807061 ,
E                    0.3521263 ,  0.08028519, -0.07729049,  0.2604472 ,  0.19974828,
E                   -0.1542004 ,  0.40313703,  0.14425965, -0.3534636 , -0.24923736],
E                  [ 0.08375961, -0.04045983,  0.0605637 , -0.30131295, -0.2831951 ,
E                    0.23712455, -0.37159252,  0.08814774,  0.13157527, -0.38715708,
E                   -0.293337  , -0.1109168 , -0.33958262, -0.21494661, -0.07879804,
E                   -0.2875032 ,  0.33664402,  0.12264654,  0.17789966,  0.3301451 ,
E                    0.06592038,  0.34754315, -0.2010875 , -0.0435704 ,  0.39497533],
E                  [-0.27133483,  0.38619342, -0.2755337 ,  0.17693359,  0.18858309,
E                    0.2718736 , -0.23108058,  0.07909197,  0.22493781, -0.08719999,
E                    0.1102799 , -0.31891218,  0.24305545, -0.20198245,  0.28433216,
E                    0.13212748,  0.29329774,  0.38348097, -0.3044585 , -0.01562016,
E                   -0.25607207,  0.18075584,  0.17669426, -0.14815351,  0.3880743 ]],
E                 dtype=float32), array([[ 3.69517840e-02, -2.30791345e-01,  3.13544750e-01,
E                    2.19569564e-01,  1.20168060e-01,  2.51423419e-02,
E                   -3.99355292e-01,  3.13688666e-01, -1.49376998e-02,
E                   -1.02677070e-01,  3.09787929e-01,  1.13272220e-01,
E                   -4.16585624e-01,  3.07422727e-01, -3.24706703e-01,
E                    3.73537481e-01, -2.30940714e-01,  1.45985633e-01,
E                   -3.21607709e-01, -2.90498525e-01,  4.15069401e-01,
E                    2.87119150e-01, -3.53997856e-01,  1.23857319e-01,
E                   -3.18670571e-02],
E                  [ 3.92136037e-01,  3.22949320e-01,  2.32057497e-01,
E                    1.97456777e-01, -1.68836042e-01, -3.39495540e-02,
E                    1.50747001e-01, -1.96552053e-01,  1.41961798e-01,
E                    2.26309389e-01,  3.93941104e-01, -2.35054836e-01,
E                   -4.03590024e-01,  1.07728522e-02, -3.33090156e-01,
E                    3.79393369e-01,  3.03022176e-01,  3.07817131e-01,
E                   -3.09693441e-02,  2.01345384e-02,  1.67068794e-01,
E                    7.42208138e-02,  1.92764983e-01, -3.76963854e-01,
E                   -2.20557302e-01],
E                  [ 3.94422412e-01, -2.94953018e-01,  3.33525866e-01,
E                    2.12094247e-01, -2.00844184e-01, -4.01659548e-01,
E                    2.48105198e-01, -5.73320314e-04,  1.78900555e-01,
E                   -3.12291086e-02,  1.89578503e-01, -1.44313753e-01,
E                   -5.47669269e-02, -2.20191181e-01,  9.68073308e-02,
E                   -2.96008795e-01, -1.10302977e-01,  4.14597422e-01,
E                    2.81459957e-01, -3.75894010e-01, -2.96038181e-01,
E                   -1.59018144e-01,  6.20081462e-02, -3.54259729e-01,
E                   -1.57240629e-01],
E                  [ 2.21471414e-01,  5.87041378e-02,  2.21303791e-01,
E                    2.00331196e-01, -1.83943838e-01, -3.60188901e-01,
E                   -3.11368704e-01, -3.04367632e-01, -3.65731835e-01,
E                   -2.14176685e-01, -3.04412603e-01, -1.38332635e-01,
E                    1.56475276e-01,  3.62410508e-02,  1.84057266e-01,
E                    2.36625299e-01, -2.26346493e-01, -2.69075096e-01,
E                    3.40439707e-01, -2.66019762e-01,  1.94032460e-01,
E                   -1.49103925e-01,  1.84042081e-01, -2.59662688e-01,
E                   -3.89551401e-01],
E                  [ 1.21033713e-01,  8.54537487e-02,  2.51351625e-01,
E                    3.33267182e-01,  3.28489840e-02,  3.53785068e-01,
E                   -3.14634204e-01,  3.25791389e-01,  1.14461921e-01,
E                    1.61911115e-01, -4.16258276e-01, -2.18777075e-01,
E                    3.09476942e-01, -2.50693500e-01, -3.24129820e-01,
E                    9.11096931e-02,  3.49818230e-01, -2.86550969e-01,
E                   -2.32217431e-01,  3.17557007e-01, -1.15589738e-01,
E                   -2.32871622e-01, -3.10071260e-01,  9.89155248e-02,
E                   -2.48940244e-01],
E                  [ 2.22917989e-01, -3.35009873e-01,  6.65600896e-02,
E                    2.86070526e-01, -3.22045445e-01, -2.31502190e-01,
E                    3.11137766e-01,  1.04858465e-01, -8.00020397e-02,
E                    1.57523870e-01,  1.48851499e-01, -2.06343874e-01,
E                   -1.96394101e-01, -2.90669173e-01, -3.66380781e-01,
E                    2.61550277e-01, -1.80413842e-01, -1.86727270e-01,
E                    3.08873773e-01,  1.15989417e-01, -8.01999718e-02,
E                    3.34482282e-01, -5.65010384e-02, -1.25089169e-01,
E                   -3.43076825e-01],
E                  [ 3.89210939e-01, -4.03849512e-01,  3.19767207e-01,
E                    9.88201723e-02, -2.95731604e-01, -2.98494905e-01,
E                    4.01536882e-01, -3.61105651e-01,  3.80579770e-01,
E                   -1.45883977e-01, -9.76698846e-02,  2.62994438e-01,
E                   -2.15406075e-01,  2.05850184e-01,  2.30280459e-02,
E                   -1.95519626e-01,  5.02734222e-02, -6.56047314e-02,
E                    3.88414115e-01, -5.48169613e-02,  1.90363303e-01,
E                   -2.15439335e-01, -4.69181091e-02,  3.44364285e-01,
E                    1.43338740e-02],
E                  [ 3.65269631e-01,  1.66748017e-01, -3.91019613e-01,
E                   -1.90773949e-01,  4.55641150e-02, -1.49531096e-01,
E                   -4.67416868e-02, -1.44909322e-01, -6.31536078e-03,
E                    6.39106855e-02,  1.02711000e-01, -1.83381140e-02,
E                    2.48088002e-01, -3.21514606e-02,  1.17384285e-01,
E                   -2.44078755e-01, -8.41873288e-02, -8.94678086e-02,
E                    9.25608873e-02, -1.45492554e-02, -3.98122758e-01,
E                   -3.96929711e-01,  3.69587630e-01,  3.95787776e-01,
E                    2.82095224e-01],
E                  [ 2.65138239e-01,  6.58082366e-02,  3.60098779e-01,
E                   -1.75288379e-01, -3.28472793e-01, -1.67236283e-01,
E                   -3.35164011e-01,  5.50692901e-02,  3.49908173e-01,
E                    2.00669333e-01,  3.29539001e-01, -3.27667177e-01,
E                   -1.15133718e-01,  2.33567774e-01, -3.16657007e-01,
E                    1.78242922e-02, -3.83684848e-04,  2.14770600e-01,
E                   -2.25261882e-01,  1.00323528e-01,  2.49704480e-01,
E                    3.88123810e-01, -2.87796736e-01, -1.61881253e-01,
E                   -3.51161450e-01],
E                  [ 3.51022452e-01, -3.86537433e-01, -3.88609707e-01,
E                   -9.26483124e-02, -9.35901999e-02, -2.64378428e-01,
E                   -3.77005219e-01, -3.46830159e-01,  3.22549373e-01,
E                   -4.10262287e-01,  3.58780175e-02, -3.80525529e-01,
E                    2.81526566e-01, -1.06488906e-01,  1.82861596e-01,
E                   -2.94784456e-01, -1.09764352e-01,  4.02561069e-01,
E                    2.19344601e-01, -6.95357919e-02,  2.81581581e-01,
E                    1.59719497e-01,  4.93917055e-03,  3.48748952e-01,
E                    2.40631908e-01]], dtype=float32), array([-0.01190614, -0.01126427,  0.00614718, -0.01081758, -0.00780756,
E                   0.01121288, -0.01169189, -0.01192154, -0.01139862, -0.01009088,
E                  -0.01153853, -0.00985813,  0.01203396,  0.01202209,  0.00043257,
E                   0.00179888, -0.01157231,  0.00857747, -0.01183189,  0.00201715,
E                  -0.01110311, -0.01160343, -0.01107689, -0.00758905,  0.01034863,
E                  -0.01094621, -0.00075951, -0.01143527, -0.00227694,  0.01172254,
E                  -0.01134772, -0.01189713,  0.0099719 ,  0.0118928 , -0.01177644,
E                   0.01035951,  0.00260996,  0.01154054, -0.00785818, -0.01147522,
E                  -0.01161643, -0.01195032, -0.00627398, -0.0117267 , -0.01126258,
E                   0.01197951,  0.01190711, -0.01114526, -0.0109251 ,  0.01189716],
E                 dtype=float32), array([[-1.79809168e-01,  1.29554316e-01, -1.00666366e-04, ...,
E                   -4.08427715e-02,  1.37073562e-01, -1.81205049e-01],
E                  [-1.56861961e-01,  2.58187681e-01,  2.80681968e-01, ...,
E                   -4.64911573e-04,  9.00247917e-02,  9.19820815e-02],
E                  [ 8.05810019e-02,  1.28088593e-01,  2.26352811e-01, ...,
E                    1.11756928e-01,  6.88935071e-02,  2.22543642e-01],
E                  ...,
E                  [-1.96332252e-03,  6.83093295e-02,  2.25238129e-01, ...,
E                   -2.47595370e-01,  2.11608112e-01,  1.46347865e-01],
E                  [ 7.13727996e-02,  1.03837013e-01, -1.73024878e-01, ...,
E                    2.57295430e-01, -2.77947575e-01,  5.95200695e-02],
E                  [-7.34454989e-02, -2.30414271e-01,  4.14609611e-02, ...,
E                    2.36997932e-01, -2.69688398e-01, -9.89005864e-02]], dtype=float32), array([[-0.19201487, -0.10551541,  0.19169688, ...,  0.10523602,
E                    0.07163665,  0.14869782],
E                  [ 0.09581527,  0.10786752,  0.15523045, ...,  0.20118836,
E                   -0.10121167,  0.18313053],
E                  [ 0.25558847, -0.06542186, -0.200433  , ..., -0.2543382 ,
E                    0.2570734 ,  0.21214023],
E                  ...,
E                  [ 0.19604842,  0.14417586, -0.09262712, ...,  0.05651504,
E                    0.16981077, -0.04860018],
E                  [-0.00893905,  0.20874432,  0.06701514, ...,  0.03400633,
E                    0.23289074, -0.1267869 ],
E                  [-0.08779675,  0.10459107,  0.1249325 , ...,  0.05494654,
E                    0.1136741 ,  0.13354948]], dtype=float32), array([[-0.31935152, -0.2691422 , -0.02021265,  0.11791547, -0.10123952,
E                    0.02392671,  0.10970373, -0.06190422, -0.19635218, -0.251688  ],
E                  [-0.1274264 , -0.29993954, -0.19553608,  0.17492357,  0.25926176,
E                    0.03605993,  0.02471756, -0.23499045,  0.20596841, -0.02454836],
E                  [-0.28260878,  0.297917  , -0.15678926,  0.13901304,  0.18141358,
E                   -0.07186494,  0.3260157 , -0.1253744 ,  0.14200798, -0.1483996 ],
E                  [-0.30230835, -0.03518361,  0.07901017, -0.00198094, -0.21154489,
E                    0.00968433,  0.20344037,  0.17393704,  0.02447308, -0.26111403],
E                  [ 0.16294754, -0.1080057 , -0.27514136, -0.01399636, -0.06604621,
E                    0.17837594, -0.279745  , -0.11656544,  0.2164138 ,  0.24897087],
E                  [ 0.18200722,  0.10012251, -0.129712  ,  0.11752149, -0.11447967,
E                   -0.197966  ,  0.2305914 ,  0.190339  ,  0.22054304, -0.18088631],
E                  [-0.04447025, -0.09669404, -0.26702338, -0.20479797,  0.00639462,
E                   -0.16866818, -0.04673946, -0.29759088,  0.06433121,  0.19832732],
E                  [-0.14095457, -0.04802692, -0.26474446,  0.07517776,  0.09127958,
E                   -0.2669543 , -0.19576004, -0.2968347 ,  0.05911382, -0.15668331],
E                  [-0.09382404, -0.18947206, -0.25303763,  0.1382512 , -0.15939245,
E                   -0.24615164, -0.12426768,  0.03302715,  0.20735127,  0.12952001],
E                  [-0.03861905, -0.15468632, -0.18696418,  0.0073056 , -0.32295454,
E                    0.06254882, -0.2398498 ,  0.24458753,  0.03436878,  0.1525663 ],
E                  [ 0.30424717, -0.23248409, -0.22833648, -0.14336677, -0.24968605,
E                   -0.06035605, -0.17926824, -0.07016141,  0.12889814,  0.24817988],
E                  [-0.04849517, -0.03348343, -0.23660396, -0.23561166,  0.1261535 ,
E                    0.1797509 , -0.29943964,  0.16259111,  0.21425135, -0.21262415],
E                  [ 0.09476262,  0.14110532, -0.31107223,  0.24679588, -0.11136276,
E                    0.20180169, -0.03418937,  0.2833631 , -0.08298329,  0.26224986],
E                  [ 0.21126199, -0.19001125,  0.21307766, -0.20981543,  0.2601676 ,
E                   -0.20278062,  0.2751154 ,  0.3019562 ,  0.15331122,  0.04161296],
E                  [ 0.22626749,  0.2732021 , -0.2860962 , -0.22302385,  0.14410797,
E                   -0.141767  ,  0.15963326, -0.17985246,  0.23258515, -0.14158908],
E                  [ 0.26732212,  0.06100929,  0.01492062,  0.10352068, -0.10861629,
E                    0.25086302, -0.2255585 , -0.17761205,  0.29744655, -0.18706517],
E                  [-0.2524025 , -0.27174032,  0.28458324, -0.21907972, -0.19337589,
E                   -0.11108077,  0.03820093, -0.21636118,  0.17260163, -0.00721635],
E                  [-0.26105362, -0.14216867, -0.14740036, -0.302365  ,  0.22700231,
E                    0.11674757,  0.29704493,  0.2876996 ,  0.30219004, -0.23841165],
E                  [ 0.20119137, -0.00184926, -0.25988406, -0.29143047, -0.1381082 ,
E                   -0.03923715,  0.23151888, -0.19447199,  0.04651675, -0.23668903],
E                  [ 0.07105131, -0.18136173, -0.12415708, -0.08552496, -0.20569769,
E                    0.32365152,  0.02533164,  0.08945419,  0.23666698, -0.10778531],
E                  [ 0.05253172,  0.25771156, -0.18104438,  0.0766651 , -0.23345608,
E                   -0.07970842,  0.0767393 ,  0.1274139 , -0.2146888 , -0.19885457],
E                  [ 0.12360667, -0.11215632, -0.30050692, -0.237552  , -0.11593328,
E                   -0.30204555,  0.19389206, -0.02850015, -0.2993259 ,  0.13798788],
E                  [-0.09668025,  0.26198366, -0.05417693,  0.01930162, -0.28914902,
E                   -0.26115218,  0.14684884,  0.1048622 , -0.12987846, -0.18575533],
E                  [-0.13935484,  0.21332008, -0.29658833, -0.3063498 ,  0.16123079,
E                   -0.13028918,  0.15021774, -0.04282332, -0.3073894 ,  0.21190447],
E                  [ 0.00159276, -0.09650763,  0.11214897,  0.01840815, -0.2959822 ,
E                    0.20117696,  0.03338543,  0.25496644,  0.13122737, -0.11528143],
E                  [ 0.00897451, -0.12617382, -0.09769709, -0.0438633 ,  0.16982906,
E                    0.06469715,  0.01945143, -0.27829784, -0.04758157,  0.07542016],
E                  [ 0.01522889, -0.11868628,  0.14041378,  0.05434483,  0.04309028,
E                    0.27659702, -0.31048816,  0.03347392, -0.24236448,  0.06700204],
E                  [-0.05659221,  0.03790259,  0.16989586, -0.32385355, -0.07979494,
E                    0.07526637, -0.02481979, -0.17283615,  0.08361983, -0.05591442],
E                  [-0.27610147, -0.03030806, -0.24902728, -0.23429975,  0.02416861,
E                   -0.29169747, -0.0076602 ,  0.22163604,  0.30544293,  0.2941304 ],
E                  [ 0.22587551, -0.00890083,  0.21382779, -0.11503504, -0.2167655 ,
E                    0.22054853,  0.25388318,  0.26397043, -0.18820667,  0.11676712],
E                  [ 0.31848773, -0.28396553,  0.09135205, -0.05513985,  0.23935224,
E                   -0.15973692, -0.14439993, -0.29058334,  0.28471175, -0.08251099],
E                  [-0.19211604, -0.04583785,  0.15268743, -0.17853309, -0.1457829 ,
E                    0.01482459, -0.04004715,  0.07800769, -0.07625479, -0.24094032],
E                  [ 0.18834391,  0.2211146 ,  0.10681865, -0.14725378, -0.26739848,
E                   -0.13950667,  0.23420349, -0.21420906,  0.13202469,  0.12030689],
E                  [-0.19352631, -0.03238774,  0.25806123,  0.10078762,  0.03173997,
E                    0.07299496,  0.28465727, -0.02202157,  0.07733882,  0.21312182],
E                  [-0.09185103, -0.19349407,  0.1872179 ,  0.2529033 ,  0.2094334 ,
E                   -0.16848245, -0.28207758, -0.05363765, -0.26924706, -0.21012267],
E                  [ 0.15754679,  0.19774894,  0.06665905,  0.2378618 ,  0.15203275,
E                   -0.07073998,  0.07371847, -0.2837572 ,  0.20222954, -0.24751948],
E                  [ 0.18696032,  0.24960111,  0.16724527, -0.24991776, -0.1129109 ,
E                    0.2722985 , -0.24544178, -0.03522966, -0.08401939, -0.10248241],
E                  [-0.09233589,  0.10373417,  0.08264216,  0.3158962 , -0.07891048,
E                    0.20313722,  0.23793685, -0.24812762, -0.01219929,  0.17276058],
E                  [-0.02246701,  0.21543993, -0.30473876,  0.14663629,  0.2285138 ,
E                   -0.14927998, -0.15300807,  0.14042644, -0.11383814, -0.08377282],
E                  [-0.24781804,  0.20859545,  0.04148087,  0.00364591,  0.22821254,
E                   -0.08708767, -0.23351681,  0.02479943, -0.13347845, -0.10288943],
E                  [-0.25013328, -0.25852093,  0.18608955, -0.01962146,  0.20741893,
E                   -0.16171096, -0.05472482,  0.07331444, -0.2944485 ,  0.12730694],
E                  [-0.07284574, -0.2926642 , -0.11139753,  0.28138664, -0.0094927 ,
E                   -0.15960774, -0.2497571 ,  0.03225494, -0.20754021, -0.02670058],
E                  [ 0.27927297, -0.00849335,  0.2769719 ,  0.2762671 , -0.2811647 ,
E                   -0.12103889,  0.27666208, -0.26770186, -0.20516606, -0.31628323],
E                  [-0.21250957, -0.23289767,  0.09061044,  0.24536937,  0.04481088,
E                   -0.18584703, -0.11041718,  0.0988466 , -0.2681184 ,  0.18524593],
E                  [ 0.08779236, -0.038965  ,  0.11526079, -0.08748984,  0.00371237,
E                   -0.13492557, -0.00319132,  0.07044867, -0.17590049, -0.01000044],
E                  [ 0.05730616,  0.17718108, -0.02864314,  0.06194642,  0.04454565,
E                    0.12602101,  0.02189857, -0.14645956,  0.02746674,  0.11726034],
E                  [ 0.29886982, -0.00097263, -0.09256555, -0.07085303, -0.10160459,
E                    0.04364016, -0.15224518,  0.279033  ,  0.03743012,  0.26539165],
E                  [-0.25890586, -0.2861969 , -0.25947186,  0.28146395,  0.15286879,
E                    0.22303489, -0.23526016, -0.09451859,  0.00496363,  0.12681815],
E                  [ 0.06254666,  0.0429217 , -0.21426477, -0.03839299, -0.31556982,
E                   -0.1367035 ,  0.13936318, -0.25129023,  0.28833672, -0.07404397],
E                  [-0.14103253,  0.25599277,  0.2099083 ,  0.22300497, -0.13288134,
E                    0.15712489,  0.21995331,  0.11681874,  0.19069365, -0.08453029]],
E                 dtype=float32), array([0.01165075, 0.01146809, 0.01145992, 0.01164567, 0.01084198,
E                  0.01095935, 0.01151626, 0.01188954, 0.01136062, 0.01177748],
E                 dtype=float32)], [array([ 0.0072544 , -0.00866685,  0.00170071,  0.00906529,  0.00284292,
E                   0.01205687,  0.        , -0.01089264, -0.00956867,  0.        ,
E                   0.00975017,  0.00958266, -0.00820071,  0.00365183,  0.00931116,
E                   0.01057489, -0.01203998, -0.00629712,  0.01063273, -0.01188213,
E                   0.        ,  0.00940913, -0.00967058,  0.00322175,  0.01050696,
E                  -0.00875996,  0.        ,  0.01160733, -0.01008119,  0.        ,
E                   0.        ,  0.00814381,  0.00690702,  0.01048299, -0.00864303,
E                  -0.01059473,  0.        , -0.00518501,  0.01113794,  0.        ,
E                  -0.00888367,  0.00727379,  0.01176138, -0.00917093,  0.        ,
E                   0.01193419,  0.00381097,  0.00680071, -0.00613574,  0.        ],
E                 dtype=float32), array([[-0.16574602, -0.2518377 ,  0.03100647,  0.06018446, -0.06551686,
E                    0.2669331 , -0.00561014,  0.40197775,  0.15659839, -0.31022012,
E                    0.18370968,  0.14408678,  0.05170297, -0.10834343, -0.05591843,
E                    0.11681951,  0.33086073,  0.12756068,  0.28769824, -0.35617888,
E                   -0.18237653, -0.39230198,  0.17763169,  0.21944474,  0.1596321 ],
E                  [ 0.03358642,  0.20516737, -0.37307048, -0.3628882 ,  0.21173513,
E                   -0.25904512, -0.15573245, -0.18373142, -0.3387961 , -0.27685094,
E                    0.2331433 ,  0.08026386,  0.39106846,  0.3471658 , -0.28687492,
E                   -0.32332712,  0.07635344, -0.27300242,  0.02284788,  0.38747406,
E                   -0.26848012, -0.36576253,  0.07091519,  0.05618003,  0.26289058],
E                  [ 0.07703129, -0.33630028,  0.37011656, -0.17099388,  0.04484576,
E                   -0.17067707, -0.34820306, -0.1018038 , -0.36198044, -0.3793144 ,
E                    0.36039665,  0.32052872, -0.03480821, -0.0212612 ,  0.11515462,
E                    0.20071153,  0.34872833, -0.12405387, -0.23112543,  0.07348812,
E                   -0.08135006,  0.08158494,  0.29639518,  0.2621844 , -0.39681983],
E                  [-0.20908928, -0.2538162 , -0.37870353,  0.4052988 , -0.26934645,
E                    0.17571744,  0.19602945,  0.27324042,  0.18652925,  0.19139227,
E                   -0.24837214,  0.20448999, -0.26618972,  0.07228784, -0.37344676,
E                    0.15206036,  0.0598107 , -0.41958842, -0.01108748,  0.3635422 ,
E                    0.19311514,  0.08520276, -0.14120519,  0.22630201, -0.35442275],
E                  [ 0.14579324, -0.028904  , -0.35644186,  0.3971074 , -0.02674859,
E                    0.01257168, -0.3204686 ,  0.18035965,  0.20499367, -0.05598068,
E                   -0.36558732,  0.04090206, -0.28762835, -0.08234249,  0.06222854,
E                   -0.32488713,  0.3588305 , -0.16063006, -0.01664616,  0.06199155,
E                   -0.3329795 , -0.15975241, -0.23838235,  0.13919291, -0.17869344],
E                  [ 0.33248824,  0.20542948,  0.11554106,  0.20936367,  0.1726972 ,
E                   -0.0756384 ,  0.41273573,  0.09231195, -0.0936924 ,  0.17857876,
E                   -0.3233059 , -0.10338282, -0.15103449, -0.06387167,  0.09440821,
E                    0.16108854,  0.10785323,  0.3286167 , -0.36984918, -0.04256437,
E                   -0.0283781 , -0.12361691, -0.32087824, -0.18805914,  0.00831043],
E                  [-0.36093646, -0.07626309, -0.23253678, -0.19075774, -0.02312634,
E                    0.36027417, -0.39991704, -0.24890505,  0.14712669,  0.1782876 ,
E                   -0.27036557, -0.31658772, -0.3823933 ,  0.07346976,  0.10423744,
E                    0.363153  ,  0.15351465, -0.22713187,  0.25453296,  0.23223883,
E                    0.06595552,  0.09073668, -0.2342555 , -0.23434384, -0.262556  ],
E                  [ 0.38248762,  0.10439329,  0.31593776,  0.12536298,  0.24648431,
E                   -0.16475359,  0.19943109, -0.35915527,  0.02028131, -0.05645078,
E                    0.07614385,  0.27305126,  0.21130253, -0.0484808 , -0.37954468,
E                    0.35202816,  0.08027941, -0.08004536,  0.26185971,  0.19975336,
E                   -0.1542004 ,  0.40402344,  0.14507733, -0.35500118, -0.24923593],
E                  [ 0.08346884, -0.03945669,  0.05596894, -0.30038866, -0.28483823,
E                    0.23715848, -0.37159252,  0.08823676,  0.13024251, -0.38715708,
E                   -0.29406753, -0.11229146, -0.33988723, -0.21459185, -0.07751495,
E                   -0.28776154,  0.33658543,  0.11989096,  0.1784442 ,  0.33019036,
E                    0.06592038,  0.34627587, -0.20000415, -0.04414657,  0.39497444],
E                  [-0.2703619 ,  0.3871835 , -0.28038085,  0.17776664,  0.1878955 ,
E                    0.27198207, -0.23108058,  0.07919338,  0.2255953 , -0.08719999,
E                    0.10970013, -0.31933963,  0.24269725, -0.20162512,  0.28498322,
E                    0.13225968,  0.292933  ,  0.38072538, -0.30327076, -0.01575127,
E                   -0.25607207,  0.18064432,  0.17798637, -0.14946994,  0.38865277]],
E                 dtype=float32), array([[ 0.03735031, -0.23079135,  0.31337503,  0.2199696 ,  0.12016806,
E                    0.02514234, -0.39235047,  0.31608915, -0.01483326, -0.10270742,
E                    0.3097474 ,  0.11327222, -0.41766274,  0.30654928, -0.3247067 ,
E                    0.37184197, -0.23170365,  0.14588034, -0.32240713, -0.29049852,
E                    0.41504636,  0.28583047, -0.3554414 ,  0.12392672, -0.03186706],
E                  [ 0.39228287,  0.32294932,  0.2319308 ,  0.19814026, -0.16883604,
E                   -0.03394955,  0.15792468, -0.19459368,  0.14257805,  0.22651109,
E                    0.39392185, -0.23505484, -0.40466747,  0.01025966, -0.33309016,
E                    0.3778978 ,  0.30250672,  0.30776966, -0.03059495,  0.02013454,
E                    0.16709532,  0.07332478,  0.19240959, -0.3766803 , -0.2205573 ],
E                  [ 0.39499876, -0.29495302,  0.33345485,  0.21178173, -0.20084418,
E                   -0.40165955,  0.2530575 ,  0.00154708,  0.1784894 , -0.03188457,
E                    0.18983795, -0.14431375, -0.0558389 , -0.2206825 ,  0.09680733,
E                   -0.29687008, -0.1111281 ,  0.4145426 ,  0.2788235 , -0.375894  ,
E                   -0.29592   , -0.15794255,  0.06122994, -0.35400686, -0.15724063],
E                  [ 0.22148763,  0.05870414,  0.2212687 ,  0.20105998, -0.18394384,
E                   -0.3601889 , -0.30795187, -0.3017336 , -0.36541545, -0.21408358,
E                   -0.3047054 , -0.13833264,  0.15539742,  0.03565786,  0.18405727,
E                    0.23479985, -0.22622208, -0.269044  ,  0.34103292, -0.26601976,
E                    0.1941923 , -0.15090962,  0.18290786, -0.2594247 , -0.3895514 ],
E                  [ 0.1213282 ,  0.08545375,  0.25134426,  0.333345  ,  0.03284898,
E                    0.35378507, -0.31032544,  0.32777175,  0.1148857 ,  0.16106369,
E                   -0.41655567, -0.21877708,  0.3083992 , -0.25135303, -0.32412982,
E                    0.0895353 ,  0.34895355, -0.28669477, -0.2334101 ,  0.317557  ,
E                   -0.11565227, -0.23257127, -0.3116768 ,  0.0997107 , -0.24894024],
E                  [ 0.22262332, -0.33500987,  0.06664429,  0.28683037, -0.32204545,
E                   -0.23150219,  0.31382564,  0.10469872, -0.07872578,  0.15629344,
E                    0.14843123, -0.20634387, -0.19747101, -0.29112616, -0.36638078,
E                    0.2596634 , -0.1812572 , -0.18666059,  0.30969322,  0.11598942,
E                   -0.08010055,  0.33410493, -0.05627819, -0.12470301, -0.34307683],
E                  [ 0.389695  , -0.4038495 ,  0.3196157 ,  0.09866095, -0.2957316 ,
E                   -0.2984949 ,  0.40507796, -0.3590082 ,  0.38062888, -0.14652409,
E                   -0.09723078,  0.26299444, -0.2164837 ,  0.20555241,  0.02302805,
E                   -0.1962573 ,  0.05006108, -0.06554811,  0.3872176 , -0.05481696,
E                    0.19028991, -0.21401232, -0.0449034 ,  0.34521744,  0.01433387],
E                  [ 0.3651996 ,  0.16674802, -0.39128846, -0.18901299,  0.04556412,
E                   -0.1495311 , -0.04049185, -0.1430489 , -0.006336  ,  0.06338464,
E                    0.10259564, -0.01833811,  0.24701399, -0.03295953,  0.11738428,
E                   -0.24603382, -0.08489092, -0.08954003,  0.09309709, -0.01454926,
E                   -0.39807627, -0.39920467,  0.3686441 ,  0.39595672,  0.28209522],
E                  [ 0.26533356,  0.06580824,  0.36009675, -0.17496236, -0.3284728 ,
E                   -0.16723628, -0.3322313 ,  0.05693522,  0.35005522,  0.20005699,
E                    0.32954952, -0.32766718, -0.11621145,  0.23317266, -0.316657  ,
E                    0.01597849, -0.0006359 ,  0.21491586, -0.22560617,  0.10032353,
E                    0.24993506,  0.38797596, -0.2879077 , -0.16151756, -0.35116145],
E                  [ 0.35102466, -0.38653743, -0.38857907, -0.09217213, -0.0935902 ,
E                   -0.26437843, -0.37076804, -0.34589234,  0.32300854, -0.4110341 ,
E                    0.03517193, -0.38052553,  0.28044856, -0.10721381,  0.1828616 ,
E                   -0.2962114 , -0.11018161,  0.402643  ,  0.21839389, -0.06953579,
E                    0.28180593,  0.15885611,  0.00421699,  0.34906617,  0.24063191]],
E                 dtype=float32), array([-0.01189141, -0.01113141,  0.00599567, -0.01120528, -0.00794805,
E                   0.01107405, -0.01154738, -0.0118996 , -0.01133333, -0.01078765,
E                  -0.01141175, -0.01005804,  0.01204815,  0.01207956,  0.00043386,
E                   0.00201758, -0.01149753,  0.00872193, -0.01181204,  0.00308085,
E                  -0.01113011, -0.01153376, -0.010952  , -0.007654  ,  0.01040254,
E                  -0.01100802, -0.00053725, -0.01153439, -0.00210658,  0.01171648,
E                  -0.0115034 , -0.01200133,  0.01000411,  0.01191423, -0.01174179,
E                   0.01044091,  0.00242295,  0.01154052, -0.00763503, -0.01146727,
E                  -0.01128385, -0.01193814, -0.00666675, -0.01128732, -0.01169452,
E                   0.01200525,  0.01186245, -0.01133145, -0.01073305,  0.01185153],
E                 dtype=float32), array([[-0.17968401,  0.12958814, -0.0003897 , ..., -0.0411629 ,
E                    0.13709101, -0.18027052],
E                  [-0.15652165,  0.25827616,  0.2804941 , ..., -0.00035396,
E                    0.08992418,  0.09171499],
E                  [ 0.0806681 ,  0.12817305,  0.22643475, ...,  0.11286739,
E                    0.0689733 ,  0.22247681],
E                  ...,
E                  [-0.00157361,  0.06975998,  0.22487472, ..., -0.24702582,
E                    0.21320099,  0.14251317],
E                  [ 0.07180376,  0.10433972, -0.17371424, ...,  0.25723898,
E                   -0.27736527,  0.05916822],
E                  [-0.0734455 , -0.23041427,  0.04146096, ...,  0.23699793,
E                   -0.2696884 , -0.09890059]], dtype=float32), array([[-0.1912353 , -0.1060425 ,  0.1919465 , ...,  0.10439667,
E                    0.07110817,  0.1488319 ],
E                  [ 0.09510297,  0.10846993,  0.15504515, ...,  0.20089936,
E                   -0.10115186,  0.18367663],
E                  [ 0.26057452, -0.06233225, -0.19562982, ..., -0.2523698 ,
E                    0.25905392,  0.21020071],
E                  ...,
E                  [ 0.19515373,  0.14208513, -0.09220449, ...,  0.0559765 ,
E                    0.16983746, -0.04833217],
E                  [-0.00867697,  0.21122558,  0.06701003, ...,  0.03481919,
E                    0.23178379, -0.12650724],
E                  [-0.08779675,  0.10459107,  0.1249325 , ...,  0.05494654,
E                    0.1136741 ,  0.13354948]], dtype=float32), array([[-0.31928745, -0.26906955, -0.02012681,  0.11794172, -0.10124979,
E                    0.02390011,  0.10939914, -0.06180064, -0.19628973, -0.25161013],
E                  [-0.12743647, -0.29978472, -0.19550866,  0.17498323,  0.25937596,
E                    0.03590465,  0.02464915, -0.23504633,  0.20594975, -0.02445322],
E                  [-0.28339455,  0.2980358 , -0.15843573,  0.13777082,  0.18178912,
E                   -0.07168837,  0.3259621 , -0.1255097 ,  0.14154723, -0.14892301],
E                  [-0.30221438, -0.03512131,  0.07901217, -0.00196891, -0.21159245,
E                    0.00972024,  0.20309909,  0.17405382,  0.02445157, -0.2610065 ],
E                  [ 0.16281754, -0.10804681, -0.27510402, -0.01404965, -0.0662535 ,
E                    0.17838643, -0.2796152 , -0.11655124,  0.21661554,  0.24891862],
E                  [ 0.18182306,  0.09998791, -0.12969989,  0.1176582 , -0.11457331,
E                   -0.19818148,  0.2311299 ,  0.18994436,  0.22045271, -0.18100138],
E                  [-0.04448739, -0.09608997, -0.26693302, -0.20436603,  0.00599243,
E                   -0.16812244, -0.04686893, -0.29736403,  0.06479403,  0.19866662],
E                  [-0.14093445, -0.04804188, -0.26475593,  0.07512619,  0.09132316,
E                   -0.26684466, -0.19550909, -0.29690906,  0.05901264, -0.15675393],
E                  [-0.09450015, -0.1893714 , -0.25339118,  0.13823904, -0.15968059,
E                   -0.24635114, -0.12440939,  0.03305101,  0.20735778,  0.12942258],
E                  [-0.0387521 , -0.15481108, -0.18696916,  0.0072487 , -0.32283342,
E                    0.06250006, -0.24019286,  0.24453472,  0.03417022,  0.15240271],
E                  [ 0.30497715, -0.23205495, -0.22785996, -0.14361459, -0.24904715,
E                   -0.06081775, -0.17904928, -0.07026711,  0.12897366,  0.24804087],
E                  [-0.04861489, -0.03338079, -0.2367325 , -0.23569365,  0.12596616,
E                    0.17948054, -0.29981893,  0.16257595,  0.21437967, -0.21264642],
E                  [ 0.09485777,  0.14121278, -0.31107807,  0.24688698, -0.11131605,
E                    0.20184883, -0.0344011 ,  0.2834459 , -0.08295376,  0.2624297 ],
E                  [ 0.21120355, -0.18995933,  0.21302761, -0.2098102 ,  0.26012507,
E                   -0.20309792,  0.27493376,  0.301932  ,  0.15332393,  0.04166927],
E                  [ 0.22521128,  0.27197993, -0.28714308, -0.22240125,  0.14214034,
E                   -0.14204845,  0.15740122, -0.17944312,  0.2326736 , -0.14245845],
E                  [ 0.2675372 ,  0.06094958,  0.01513814,  0.10378737, -0.10843656,
E                    0.25154665, -0.22542702, -0.17738788,  0.2974432 , -0.18722208],
E                  [-0.25233865, -0.27161595,  0.28459927, -0.21904959, -0.19337073,
E                   -0.11121418,  0.03796345, -0.2163004 ,  0.17272078, -0.0071936 ],
E                  [-0.26102114, -0.14225172, -0.1473984 , -0.3024093 ,  0.22710714,
E                    0.11683556,  0.29735574,  0.287657  ,  0.3021134 , -0.23850757],
E                  [ 0.20128691, -0.00075665, -0.2598489 , -0.29135793, -0.13904631,
E                   -0.03946763,  0.23115614, -0.1939999 ,  0.04798488, -0.23658115],
E                  [ 0.07139043, -0.18123136, -0.12394288, -0.08454774, -0.20554863,
E                    0.32451257,  0.02533755,  0.08996911,  0.23685536, -0.1075503 ],
E                  [ 0.05259362,  0.257803  , -0.18102887,  0.0767063 , -0.23348111,
E                   -0.07977723,  0.07638577,  0.12752527, -0.21456838, -0.1988218 ],
E                  [ 0.12353113, -0.11233413, -0.30055124, -0.23761544, -0.11598042,
E                   -0.3018612 ,  0.19407438, -0.02848329, -0.29948023,  0.1378899 ],
E                  [-0.09686048,  0.26186946, -0.05418361,  0.01934414, -0.2893256 ,
E                   -0.26098096,  0.14714758,  0.10482841, -0.1299458 , -0.18554033],
E                  [-0.13929944,  0.21343267, -0.29653943, -0.3062976 ,  0.16133471,
E                   -0.13010174,  0.1501441 , -0.04294381, -0.30743167,  0.2120482 ],
E                  [ 0.00151384, -0.09658092,  0.11216386,  0.01833805, -0.29601637,
E                    0.20126274,  0.03357187,  0.2549008 ,  0.1312905 , -0.11530811],
E                  [ 0.00886934, -0.12633625, -0.09774296, -0.04403971,  0.16969475,
E                    0.06471492,  0.01960722, -0.2783709 , -0.04760902,  0.07529732],
E                  [ 0.01737066, -0.11818796,  0.1424404 ,  0.05718692,  0.04514444,
E                    0.27965212, -0.30873024,  0.03475579, -0.24231479,  0.06858102],
E                  [-0.05660693,  0.03811905,  0.16994037, -0.32374611, -0.07980082,
E                    0.07505618, -0.02506194, -0.17277291,  0.08375746, -0.05590949],
E                  [-0.275951  , -0.03046633, -0.24912478, -0.23446901,  0.02432722,
E                   -0.29165938, -0.00740643,  0.22162083,  0.30525753,  0.2938596 ],
E                  [ 0.22558428, -0.00907023,  0.21376573, -0.11508298, -0.21714205,
E                    0.22055484,  0.25386378,  0.26383626, -0.18823576,  0.11673598],
E                  [ 0.31873247, -0.28464288,  0.09179601, -0.05497567,  0.23936555,
E                   -0.1597114 , -0.1446581 , -0.29133686,  0.28390118, -0.08313048],
E                  [-0.19499156, -0.04770026,  0.14937097, -0.18062627, -0.14824185,
E                    0.01239854, -0.04196074,  0.07605364, -0.0777941 , -0.24286659],
E                  [ 0.1894385 ,  0.22187364,  0.10824307, -0.14696652, -0.26611182,
E                   -0.13811153,  0.23527707, -0.21369411,  0.13243411,  0.12146009],
E                  [-0.19362506, -0.03228609,  0.25809285,  0.10091501,  0.03169512,
E                    0.07281037,  0.2844522 , -0.02204949,  0.07741809,  0.213227  ],
E                  [-0.09209426, -0.19338591,  0.18725699,  0.25301424,  0.20925982,
E                   -0.16888766, -0.28228244, -0.05374066, -0.2692282 , -0.21003234],
E                  [ 0.15747903,  0.19758147,  0.06663069,  0.23772174,  0.15195191,
E                   -0.07076771,  0.07390396, -0.28380865,  0.20217726, -0.24767286],
E                  [ 0.18453729,  0.24747942,  0.16669182, -0.2505807 , -0.11467191,
E                    0.27100143, -0.24690513, -0.03777865, -0.08515958, -0.1036814 ],
E                  [-0.09248278,  0.10349816,  0.0828415 ,  0.3160686 , -0.07937701,
E                    0.20299071,  0.23819427, -0.24832134, -0.01221503,  0.17286326],
E                  [-0.02254129,  0.21565424, -0.3049158 ,  0.1467004 ,  0.22878502,
E                   -0.14947207, -0.15305291,  0.14022988, -0.11383711, -0.08355807],
E                  [-0.2471721 ,  0.20852275,  0.04184384,  0.00408079,  0.22862914,
E                   -0.08619253, -0.23322128,  0.02514978, -0.1335801 , -0.10293337],
E                  [-0.24768859, -0.25715214,  0.18846081, -0.01842501,  0.20903906,
E                   -0.15983668, -0.05414783,  0.07511041, -0.2926734 ,  0.12825437],
E                  [-0.06849919, -0.28923067, -0.10698038,  0.2841936 , -0.00752502,
E                   -0.15635076, -0.24785645,  0.03578322, -0.20364489, -0.02442713],
E                  [ 0.27929997, -0.0084163 ,  0.27692282,  0.2763589 , -0.28114998,
E                   -0.12084487,  0.27643263, -0.2675869 , -0.20526083, -0.31617874],
E                  [-0.21205282, -0.23272605,  0.0907425 ,  0.24518123,  0.04476521,
E                   -0.18558247, -0.11074412,  0.09912941, -0.26811153,  0.18506755],
E                  [ 0.08750024, -0.03916848,  0.11529236, -0.0875747 ,  0.00356953,
E                   -0.13510606, -0.00297531,  0.07023706, -0.17591672, -0.01015342],
E                  [ 0.05726809,  0.17740868, -0.0286911 ,  0.0621075 ,  0.04485948,
E                    0.12634899,  0.02179057, -0.14636335,  0.02760016,  0.11760059],
E                  [ 0.29883996, -0.00104962, -0.09310652, -0.07134771, -0.10164735,
E                    0.04364149, -0.15261292,  0.2790275 ,  0.03724213,  0.26523605],
E                  [-0.2573196 , -0.2856244 , -0.25816122,  0.28226644,  0.1537985 ,
E                    0.22433315, -0.23479858, -0.09358462,  0.00546942,  0.12705985],
E                  [ 0.0624753 ,  0.04318812, -0.21396817, -0.03776656, -0.31520867,
E                   -0.13690826,  0.1394974 , -0.25146073,  0.2884409 , -0.07365116],
E                  [-0.14063029,  0.25611988,  0.21174139,  0.22262946, -0.13273196,
E                    0.1576768 ,  0.22085637,  0.11665362,  0.19122282, -0.08250878]],
E                 dtype=float32), array([0.01159463, 0.01134111, 0.01143942, 0.01156336, 0.01082283,
E                  0.01103639, 0.01174   , 0.01182879, 0.01132041, 0.01170115],
E                 dtype=float32)])

tests/reproducibility/fixtures.py:41: AssertionError
----------------------------- Captured stdout call -----------------------------
Epoch 1/4

1/3 [=========>....................] - ETA: 0s - loss: 12.0645
3/3 [==============================] - 0s 1ms/step - loss: 12.5564
Epoch 2/4

1/3 [=========>....................] - ETA: 0s - loss: 12.9175
3/3 [==============================] - 0s 1ms/step - loss: 12.2991
Epoch 3/4

1/3 [=========>....................] - ETA: 0s - loss: 11.6822
3/3 [==============================] - 0s 1ms/step - loss: 12.6043
Epoch 4/4

1/3 [=========>....................] - ETA: 0s - loss: 13.1449
3/3 [==============================] - 0s 1ms/step - loss: 12.1539
Epoch 1/4

1/3 [=========>....................] - ETA: 0s - loss: 12.0645
3/3 [==============================] - 0s 1ms/step - loss: 12.5564
Epoch 2/4

1/3 [=========>....................] - ETA: 0s - loss: 12.9175
3/3 [==============================] - 0s 2ms/step - loss: 12.2991
Epoch 3/4

1/3 [=========>....................] - ETA: 0s - loss: 11.6822
3/3 [==============================] - 0s 1ms/step - loss: 12.6043
Epoch 4/4

1/3 [=========>....................] - ETA: 0s - loss: 13.1449
3/3 [==============================] - 0s 1ms/step - loss: 12.1539
Epoch 1/4

1/3 [=========>....................] - ETA: 0s - loss: 12.0645
3/3 [==============================] - 0s 1ms/step - loss: 12.5564
Epoch 2/4

1/3 [=========>....................] - ETA: 0s - loss: 12.9175
3/3 [==============================] - 0s 1ms/step - loss: 12.2991
Epoch 3/4

1/3 [=========>....................] - ETA: 0s - loss: 11.6822
3/3 [==============================] - 0s 1ms/step - loss: 12.6043
Epoch 4/4

1/3 [=========>....................] - ETA: 0s - loss: 13.1449
3/3 [==============================] - 0s 2ms/step - loss: 12.1539
Epoch 1/4

1/3 [=========>....................] - ETA: 0s - loss: 12.0645
3/3 [==============================] - 0s 1ms/step - loss: 12.5564
Epoch 2/4

1/3 [=========>....................] - ETA: 0s - loss: 12.9175
3/3 [==============================] - 0s 1ms/step - loss: 12.2991
Epoch 3/4

1/3 [=========>....................] - ETA: 0s - loss: 11.6822
3/3 [==============================] - 0s 1ms/step - loss: 12.6043
Epoch 4/4

1/3 [=========>....................] - ETA: 0s - loss: 13.1449
3/3 [==============================] - 0s 1ms/step - loss: 12.1539
Epoch 1/4

1/3 [=========>....................] - ETA: 0s - loss: 12.0645
3/3 [==============================] - 0s 1ms/step - loss: 12.5564
Epoch 2/4

1/3 [=========>....................] - ETA: 0s - loss: 12.9175
3/3 [==============================] - 0s 1ms/step - loss: 12.2991
Epoch 3/4

1/3 [=========>....................] - ETA: 0s - loss: 11.6822
3/3 [==============================] - 0s 1ms/step - loss: 12.6043
Epoch 4/4

1/3 [=========>....................] - ETA: 0s - loss: 13.1449
3/3 [==============================] - 0s 1ms/step - loss: 12.1539
Epoch 1/4

1/3 [=========>....................] - ETA: 0s - loss: 12.0645
3/3 [==============================] - 0s 936us/step - loss: 12.5564
Epoch 2/4

1/3 [=========>....................] - ETA: 0s - loss: 12.9175
3/3 [==============================] - 0s 1ms/step - loss: 12.2991
Epoch 3/4

1/3 [=========>....................] - ETA: 0s - loss: 11.6822
3/3 [==============================] - 0s 1ms/step - loss: 12.6043
Epoch 4/4

1/3 [=========>....................] - ETA: 0s - loss: 13.1449
3/3 [==============================] - 0s 1ms/step - loss: 12.1539
Epoch 1/4

1/3 [=========>....................] - ETA: 0s - loss: 12.0645
3/3 [==============================] - 0s 1ms/step - loss: 12.5564
Epoch 2/4

1/3 [=========>....................] - ETA: 0s - loss: 12.9175
3/3 [==============================] - 0s 1ms/step - loss: 12.2991
Epoch 3/4

1/3 [=========>....................] - ETA: 0s - loss: 11.6822
3/3 [==============================] - 0s 1ms/step - loss: 12.6043
Epoch 4/4

1/3 [=========>....................] - ETA: 0s - loss: 13.1449
3/3 [==============================] - 0s 1ms/step - loss: 12.1539
Epoch 1/4

1/3 [=========>....................] - ETA: 0s - loss: 12.0645
3/3 [==============================] - 0s 1ms/step - loss: 12.5564
Epoch 2/4

1/3 [=========>....................] - ETA: 0s - loss: 11.7316
3/3 [==============================] - 0s 1ms/step - loss: 12.6142
Epoch 3/4

1/3 [=========>....................] - ETA: 0s - loss: 13.1749
3/3 [==============================] - 0s 1ms/step - loss: 12.1678
Epoch 4/4

1/3 [=========>....................] - ETA: 0s - loss: 12.5269
3/3 [==============================] - 0s 1ms/step - loss: 12.2119
=============================== warnings summary ===============================
/Users/jun021/miniconda3/envs/stellargraph-dev/lib/python3.7/site-packages/tensorflow/python/pywrap_tensorflow_internal.py:15
  /Users/jun021/miniconda3/envs/stellargraph-dev/lib/python3.7/site-packages/tensorflow/python/pywrap_tensorflow_internal.py:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    import imp

tests/reproducibility/test_graphsage.py::test_unsupervised[True-1-300]
  /Users/jun021/miniconda3/envs/stellargraph-dev/lib/python3.7/site-packages/tensorflow/python/framework/indexed_slices.py:349: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated since Python 3.3,and in 3.9 it will stop working
    if not isinstance(values, collections.Sequence):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
========== 2 failed, 1798 passed, 2 warnings in 37397.79s (10:23:17) ===========

The two failures out of 300 runs are for:

Didn’t see any failures for #970 (I added test_link_prediction[True] back into the test set before running the above test)

1reaction
huonwcommented, Mar 13, 2020

I didn’t include them here, because they’re huge and they’re available in the public buildkite logs linked in the description.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Tensorflow release 2.2.0 not found via pip install #39265
Sadly, pip install failed to install the update as it was unable to find release 2.2.0. (Clearing the cache of pip didn't help.) ......
Read more >
Keras requires TensorFlow 2.2 or higher
I have both keras 2.4.3 and tensorflow 2.2.0 installed in anaconda environment. I uninstalled and installed jupiter notebook but it didn't help.
Read more >
I can't install TensorFlow-macos a…
Yes, I am running python 3.8.10. And for whl files, I am using MacBook Pro 16' with intel CPU, so, I do have...
Read more >
TensorFlow Model Analysis | TFX
The model we trained was for the Chicago Taxi Example, which uses the Taxi Trips dataset released by the City of Chicago. Explore...
Read more >
Install spaCy · spaCy Usage Documentation
The latest spaCy releases are available over pip and conda. ... any pipelines have been loaded. require_gpu will raise an error if no...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found