Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Python2 crashes with non-ascii caracters.

See original GitHub issue


When using PyInquirer with python2 I face a problem when the options include non-ascii characters. Python3 works fine though.

Here is a minimal working example that demonstrates this behaviour.

# -*- coding: utf-8 -*-
from __future__ import print_function, unicode_literals
from PyInquirer import prompt

def main():
    choice = 'John’s Pizza'
    questions = [
            'type': 'list',
            'name': 'pizza',
            'message': 'Pizzeria:',
            'choices' : [choice]
    answer = prompt(questions)
    pizza = answer['pizza']
    print('Answer is |' + pizza + '|' )

if __name__ == '__main__':

Python3 execution:

❯ python3  
? Pizzeria:  John’s Pizza
Answer is |John’s Pizza|

Python2 execution:

❯ python2
? Pizzeria:  (Use arrow keys)                                                                                                                                       
Traceback (most recent call last):
  File "", line 20, in <module>
  File "", line 15, in main
    answer = prompt(questions)
  File "/usr/local/lib/python2.7/dist-packages/PyInquirer/", line 71, in prompt
  File "/usr/local/lib/python2.7/dist-packages/prompt_toolkit/", line 625, in run_application
    result =
  File "/usr/local/lib/python2.7/dist-packages/prompt_toolkit/", line 413, in run
  File "/usr/local/lib/python2.7/dist-packages/prompt_toolkit/", line 358, in _redraw
    self.renderer.render(self, self.layout, is_done=self.is_done)
  File "/usr/local/lib/python2.7/dist-packages/prompt_toolkit/", line 429, in render
  File "/usr/local/lib/python2.7/dist-packages/prompt_toolkit/layout/", line 142, in write_to_screen
    sizes = self._divide_heigths(cli, write_position)
  File "/usr/local/lib/python2.7/dist-packages/prompt_toolkit/layout/", line 177, in _divide_heigths
    dimensions = [get_dimension_for_child(c, index) for index, c in enumerate(self.children)]
  File "/usr/local/lib/python2.7/dist-packages/prompt_toolkit/layout/", line 175, in get_dimension_for_child
    return c.preferred_height(cli, write_position.width, write_position.extended_height)
  File "/usr/local/lib/python2.7/dist-packages/prompt_toolkit/layout/", line 1652, in preferred_height
    return self.content.preferred_height(cli, width, max_available_height)
  File "/usr/local/lib/python2.7/dist-packages/prompt_toolkit/layout/", line 1000, in preferred_height
    cli, width - total_margin_width, max_available_height, wrap_lines),
  File "/usr/local/lib/python2.7/dist-packages/prompt_toolkit/layout/", line 254, in preferred_height
    content = self.create_content(cli, width, None)
  File "/usr/local/lib/python2.7/dist-packages/prompt_toolkit/layout/", line 259, in create_content
    tokens_with_mouse_handlers = self._get_tokens_cached(cli)
  File "/usr/local/lib/python2.7/dist-packages/prompt_toolkit/layout/", line 239, in _get_tokens_cached
    cli.render_counter, lambda: self.get_tokens(cli))
  File "/usr/local/lib/python2.7/dist-packages/prompt_toolkit/", line 37, in get
    value = getter_func()
  File "/usr/local/lib/python2.7/dist-packages/prompt_toolkit/layout/", line 239, in <lambda>
    cli.render_counter, lambda: self.get_tokens(cli))
  File "/usr/local/lib/python2.7/dist-packages/PyInquirer/prompts/", line 98, in _get_choice_tokens
    append(i, choice)
  File "/usr/local/lib/python2.7/dist-packages/PyInquirer/prompts/", line 92, in append
    tokens.append((T.Selected if selected else T, str(choice[0]),
UnicodeEncodeError: 'ascii' codec can't encode character u'\u2019' in position 4: ordinal not in range(128)

The apostrophe unicode character is what is breaking the python2 execution.

Issue Analytics

  • State:closed
  • Created 5 years ago
  • Comments:11 (10 by maintainers)

github_iconTop GitHub Comments

tmbocommented, Sep 19, 2018

Yes that would be great, if you tag it with 1.1.0a1 (or whatever your next release is) “normal” people wont get it if they install from pip only if you specifically use the version number, that would be best 👍

CITGurucommented, Sep 19, 2018

No, not anytime soon. Cos I am planning to add editor and some other fix. I need to carry out test against some environments. Just too busy these days in my company. Also I wanted to add some of the TODO feature. But, I can create a pre release version, so people can use most recent fix with no new feature. 👍

Read more comments on GitHub >

github_iconTop Results From Across the Web

Python2 crashes with non-ascii characters. · Issue #28 - GitHub
Hi, When using huepy with python2 I face a problem when the string to be printed includes non-ascii characters. Python3 works fine though....
Read more >
#26103 (Python 2 crash with non-ASCII characters in settings ...
Python 2 crash with non-ASCII characters in settings. ... coding: utf-8 -*- to django/conf/ , causes a test failure on Python 2.7:
Read more >
Heroku crashing due to "Non-ASCII character '\xe2' in file" error
It appears that when I erase everything in the file but the header and have it return none , it's still giving me...
Read more >
crashes when uploading job with non-ascii chars on python2.7
If run on python 2.7.13, jenkins-python crashes if job xml contains non-ascii characters. Traceback (most recent call last):
Read more >
Why does csh (tcsh) crash when I type non-ASCII characters?
Issue. User types non-ASCII characters (e.g. Swedish characters with umlaut: å, ä, ö) on the csh/tcsh command line.
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Post

No results found

github_iconTop Related Hashnode Post

No results found