Python 3 Port - TypeError: Object of type bytes is not JSON serializable
See original GitHub issueI am running into the following issue using Python 3.6 and Python 3.7 (I thought 3.7 might have resolved this)
2019-04-18 14:02:17.059 - keylime.cloudverifier - INFO - Starting Cloud Verifier (tornado) on port 8881, use <Ctrl-C> to stop
2019-04-18 14:02:17.059 - keylime.cloudverifier_common - INFO - Setting up TLS...
2019-04-18 14:02:17.059 - keylime.cloudverifier_common - INFO - Generating a new CA in /var/lib/keylime/cv_ca and a client certificate for connecting
2019-04-18 14:02:17.060 - keylime.cloudverifier_common - INFO - use keylime_ca -d /var/lib/keylime/cv_ca to manage this CA
2019-04-18 14:02:17.060 - keylime.cloudverifier_common - WARNING - CAUTION: using default password for CA, please set private_key_pw to a strong password
Traceback (most recent call last):
File "/usr/local/bin/keylime_verifier", line 11, in <module>
load_entry_point('keylime==1.2', 'console_scripts', 'keylime_verifier')()
File "/usr/local/lib/python3.7/site-packages/keylime-1.2-py3.7.egg/keylime/cloud_verifier_tornado.py", line 495, in main
context = cloud_verifier_common.init_mtls()
File "/usr/local/lib/python3.7/site-packages/keylime-1.2-py3.7.egg/keylime/cloud_verifier_common.py", line 122, in init_mtls
ca_util.cmd_init(tls_dir)
File "/usr/local/lib/python3.7/site-packages/keylime-1.2-py3.7.egg/keylime/ca_util.py", line 153, in cmd_init
write_private(priv)
File "/usr/local/lib/python3.7/site-packages/keylime-1.2-py3.7.egg/keylime/ca_util.py", line 423, in write_private
priv_encoded = json.dumps(priv)
File "/usr/lib64/python3.7/json/__init__.py", line 231, in dumps
return _default_encoder.encode(obj)
File "/usr/lib64/python3.7/json/encoder.py", line 199, in encode
chunks = self.iterencode(o, _one_shot=True)
File "/usr/lib64/python3.7/json/encoder.py", line 257, in iterencode
return _iterencode(o, 0)
File "/usr/lib64/python3.7/json/encoder.py", line 179, in default
raise TypeError(f'Object of type {o.__class__.__name__} '
TypeError: Object of type bytes is not JSON serializable
Set up steps:
- Install dependencies:
# dnf install python3-devel python3-pip python3-setuptools python3-tornado python3-virtualenv python3-zmq python3-yaml python3-m2crypto python3-pycryptodomex libselinux-python3
# dnf install procps libtool gcc make automake m2crypto redhat-rpm-config libselinux-python gnulib glib2-devel glib2-static uthash-devel wget which
- Run
2to3
pm code base - Install keylime
python3 setup.py install
- Start the
keylime_verifier
From what I can tell the issue starts here:
This takes the return from crypto.generate_random_key
, encodes it as base64 and attempts to load that into a JSON object, this is then refused with TypeError: Object of type bytes is not JSON serializable
Opening this issue, not as a bug, but a means to discuss a way forwards.
Tagging @jetwhiz
Issue Analytics
- State:
- Created 4 years ago
- Comments:76 (75 by maintainers)
Top Results From Across the Web
TypeError: Object of type 'bytes' is not JSON serializable
The way I ended up solving it: the write_to_file.json will have everything up to the bytes object that is causing the issue.
Read more >Object of type is not JSON serializable in Python - LinuxPip
“Object of type is not JSON serializable” is a common error message in Python. It basically says that the built-in json module cannot...
Read more >TypeError: Object of type bytes is not JSON serializable when ...
When I try this out, it throws an error, with "TypeError: Object of type bytes is not JSON serializable". If I simply want...
Read more >typeerror: object of type cursor is not json serializable - You.com
Your object is a bytes object. You need to decode it first (as you did in the print) before drtying to serialize (dumps)...
Read more >Python JSON Serialize Set - PYnative
To solve TypeError: Object of type set is not JSON serializable we need to build a custom encoder to make set JSON serializable....
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Hi @lukehinds
It looks like py3 now exports byte arrays from
base64.b64encode
instead of ASCII strings when performing its base64 encoding. We will need to convert this byte array back to ASCII for this to be JSON serializeable, using.decode('ascii')
.For https://github.com/keylime/keylime/blob/e7c153a16fa47e3b411ddbcd18f04a66b37e8898/keylime/ca_util.py#L448
Change
base64.b64encode(crypto.generate_random_key())
tobase64.b64encode(crypto.generate_random_key()).decode('ascii')
so it can be serialized.Can you see if that fixes the issue for you? We might need to do this everywhere base64 is performed …
@lukehinds – can you try
bytes(nonce, encoding="utf8").hex()
and see if that works?