TreasureData connector could not include non-ascii code query in some case.

Issue Summary

Hi, I’m trying to query Treasure Data including NON-ASCII characters. But it could not execute and another data storage works fine.(e.f. MySQL …)

Steps to Reproduce

1. Using TreasureData and execute the query in below.

• NG case

select
    time AS "日付" -- non-ascii character.
from
    raw
limit 1

• OK case

select
    time AS "datetime" 
from
    raw
limit 1

1. An error has occurred and could not show query.

Error running query: 'ascii' codec can't encode characters in position 3-4: ordinal not in range(128)

Technical details:

• Redash Version: Redash 2.0.0+b2990
• Browser/OS: Chrome
• How did you install Redash: wget and using ubuntu.

[toru-takahashi]

I’m not familiar with Python’s encoding issue. But, as a possible workaround is to create sitecustomize.py in python2.7/site-packages/sitecustomize.py.

import sys
sys.setdefaultencoding('UTF8')

I found one blog which says similar issue. (Japanese) > https://www.yamamanx.com/redash-encode-error/

I could get the correct result. But, I’m not sure this works well for redash.

>>> columns_data = [(row[0], cursor.show_job()['hive_result_schema'][i][1]) for i,row in enumerate(cursor.description)]
>>>
>>> print(columns_data)
[(u'\u65e5\u4ed8', u'integer')]

[toru-takahashi]

Good to hear!