question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

run HeteroSecureBoot example failed

See original GitHub issue

I used the docker_standalone-fate-1.2.0.tar.gz to run FATE. But When I run the hetero_secureboost Binary-Class problem, there occurs a problem in secureboost_0 step.

"2020-01-10 11:55:57,178 - api_utils.py[line:83] - INFO: local api response: /v1/schedule/2020011011554180211926/secureboost_0/2020011011554180211926_secureboost_0/guest/10000/status {'retcode': 0, 'retmsg': 'success'}"
"2020-01-10 11:55:57,179 - task_executor.py[line:120] - INFO: run 2020011011554180211926 secureboost_0 2020011011554180211926_secureboost_0 guest 10000 task"
"2020-01-10 11:55:57,179 - task_executor.py[line:121] - INFO: {'BoostingTreeParam': {'tree_param': {'criterion_method': 'xgboost', 'criterion_params': [0.1], 'max_depth': 5, 'min_sample_split': 2, 'min_impurity_split': 0.001, 'min_leaf_node': 1, 'max_split_nodes': 1024, 'feature_importance_type': 'split', 'n_iter_no_change': True, 'tol': 0.001, 'use_missing': False, 'zero_as_missing': False}, 'task_type': 'classification', 'objective_param': {'objective': 'cross_entropy', 'params': [1.5]}, 'learning_rate': 0.1, 'num_trees': 5, 'subsample_feature_rate': 1, 'n_iter_no_change': True, 'tol': 0.0001, 'encrypt_param': {'method': 'paillier', 'key_length': 1024}, 'bin_num': 10, 'use_missing': False, 'zero_as_missing': False, 'encrypted_mode_calculator_param': {'mode': 'strict', 're_encrypted_rate': 1}, 'predict_param': {'threshold': 0.5}, 'cv_param': {'n_splits': 5, 'mode': 'hetero', 'role': 'guest', 'shuffle': False, 'random_seed': 103, 'need_cv': False}, 'validation_freqs': 1}, 'initiator': {'role': 'guest', 'party_id': 10000}, 'job_parameters': {'work_mode': 0, 'model_id': 'arbiter-10000#guest-10000#host-10000#model', 'model_version': '2020011011554180211926'}, 'role': {'guest': [10000], 'host': [10000], 'arbiter': [10000]}, 'config': '/fate/examples/federatedml-1.x-examples/user_config/train_conf.config_1578657341_4667', 'dsl': '/fate/examples/federatedml-1.x-examples/user_config/train_dsl.config_1578657341_1180', 'function': 'submit_job', 'local': {'role': 'guest', 'party_id': 10000}, 'CodePath': 'federatedml/tree/hetero_secureboosting_tree_guest.py/HeteroSecureBoostingTreeGuest', 'module': 'HeteroSecureBoost'}"
"2020-01-10 11:55:57,179 - task_executor.py[line:122] - INFO: {'data': {'train_data': ['intersection_0.train'], 'eval_data': ['intersection_1.eval']}}"
"2020-01-10 11:55:57,180 - hetero_secureboosting_tree_guest.py[line:293] - INFO: begin to train secureboosting guest model"
"2020-01-10 11:55:57,420 - hetero_secureboosting_tree_guest.py[line:130] - INFO: convert feature to bins"
"2020-01-10 11:55:57,428 - task_executor.py[line:132] - ERROR: list index out of range"
concurrent.futures.process._RemoteTraceback:
"""
Traceback (most recent call last):
File "/usr/local/lib/python3.6/concurrent/futures/process.py", line 175, in _process_worker
r = call_item.fn(*call_item.args, **call_item.kwargs)
File "/fate/eggroll/api/standalone/eggroll.py", line 264, in do_map_partitions
v = _mapper(_generator_from_cursor(cursor))
File "/fate/federatedml/feature/binning/quantile_binning.py", line 153, in approxi_quantile
QuantileBinning.insert_datas(data_instances, summary_dict, cols_dict, header, is_sparse)
File "/fate/federatedml/feature/binning/quantile_binning.py", line 173, in insert_datas
col_name = header[col_idx]
IndexError: list index out of range
"""
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/fate/fate_flow/driver/task_executor.py", line 123, in run_task
run_object.run(parameters, task_run_args)
File "/fate/federatedml/model_base.py", line 91, in run
this_data_output = func(*params)
File "/fate/federatedml/tree/hetero_secureboosting_tree_guest.py", line 296, in fit
self.convert_feature_to_bin(data_inst)
File "/fate/federatedml/tree/hetero_secureboosting_tree_guest.py", line 138, in convert_feature_to_bin
binning_obj.fit_split_points(data_instance)
File "/fate/federatedml/feature/binning/quantile_binning.py", line 85, in fit_split_points
summary_dict = data_instances.mapPartitions(f)
File "/fate/arch/api/utils/profile_util.py", line 31, in _fn
rtn = func(*args, **kwargs)
File "/fate/arch/api/table/eggroll/table_impl.py", line 117, in mapPartitions
return DTable(self._dtable.mapPartitions(func), session_id=self._session_id)
File "/fate/eggroll/api/standalone/eggroll.py", line 771, in mapPartitions
result = r.result()
File "/usr/local/lib/python3.6/concurrent/futures/_base.py", line 432, in result
return self.__get_result()
File "/usr/local/lib/python3.6/concurrent/futures/_base.py", line 384, in __get_result
raise self._exception
IndexError: list index out of range
"2020-01-10 11:55:57,429 - api_utils.py[line:78] - INFO: local api request: http://172.19.0.3:9380/v1/schedule/2020011011554180211926/secureboost_0/2020011011554180211926_secureboost_0/guest/10000/status"
"2020-01-10 11:55:57,437 - api_utils.py[line:81] - INFO: {"retcode":0,"retmsg":"success"}

Does anyone also meet above problem~

Issue Analytics

  • State:open
  • Created 4 years ago
  • Comments:9 (4 by maintainers)

github_iconTop GitHub Comments

1reaction
better629commented, Jan 16, 2020

@mgqa34 Could you please run the hetero_secureboost Binary-Class problem with quick_run.py and breast_b/a.csv data, and take a look that if there has above problem.

0reactions
BeatBoxerLrdcommented, May 29, 2020

You can try to submit the task after modifying the table name and namespace.

Read more comments on GitHub >

github_iconTop Results From Across the Web

No results found

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found