[rllib] Export model failure for TupleActions

What is the problem?

I wanted to export a model which has tuple actions. But I got the AttributeError: 'TupleActions' object has no attribute 'dtype' error message while exporting TF model.

Ray version and other system information (Python version, TensorFlow version, OS): OS: Ubuntu 16.04 Python: 3.7 Ray: 0.7.6(also tested with 0.8.1) TF: 1.13.1(also tested with 1.15.0)

Reproduction (REQUIRED)

Please provide a script that can be run to reproduce the issue. The script should have no external library dependencies (i.e., use fake or mock data / environments):

I started from https://github.com/ray-project/ray/blob/master/rllib/examples/autoregressive_action_dist.py example and my script is https://gist.github.com/kepricon/e3d7ffc7eeb1dd1e8193451d7535c02a I just added "training_iteration": 5 to quick test export model and added 3 lines(local_dir, checkpoint_at_end, export_formats) at the very end of run config

If we cannot run your script, we cannot fix your issue.

• I have verified my script runs in a clean environment and reproduces the issue.
• I have verified the issue also occurs with the latest wheels.

[sven1977]

Update: This bug is on my TODO list for next week.

[kepricon]

https://ray.readthedocs.io/en/latest/installation.html#latest-snapshots-nightlies

if i install the latest snapshot whl from above link, will it contain the change?