question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Importing from CSV some text characters are replaced by `?`

See original GitHub issue

System information:

  • Windows 10 / 2021 May Update
  • DBeaver version - 21.1.3

Connection specification:

  • Database name and version

  • Driver name image

  • Do you use tunnels or proxies (SSH, SOCKS, etc)? Nope it’s locally

Describe the problem you’re observing:

I am importing a csv to database and some German letters it shows them like this ( they contain a letter like ? )

image

But actually on the csv they are okay

image

Steps to reproduce, if exist:

Import the following csv ( after you unzip the attached file ) on a mysql database with a table with following columns

123.zip

image

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:9 (5 by maintainers)

github_iconTop GitHub Comments

2reactions
ShadelessFoxcommented, Jul 28, 2021

Just a note: in case of Notepad++, you need to use <kbd>Convert to UTF-8</kbd> option rather than <kbd>UTF-8</kbd>:

image

1reaction
ShadelessFoxcommented, Jul 28, 2021

Actually, I missed the attachment, my bad.

I was able to reproduce your issue and found several workarounds:

  1. Your file is encoded in extended ASCII, also known as latin1. You can specify latin1 as encoding in CSV importer.
  2. You can convert file encoding to UTF-8.

Using these approaches, you don’t have to edit dbeaver.ini file.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Prevent file import errors caused by special characters or ...
Click Edit > Replace. In the Find what field, enter the character you want to search for.
Read more >
When importing data from a CSV file, special or International ...
Here's an example where a CSV with special characters wasn't encoded in UTF-8. This is how the location's name would appear within MetaLocator...
Read more >
How to deal with special characters in CSV - CSV Loader
To avoid that, you need to import CSV files into Excel using the special wizard to display data correctly. Go to "Data" tab...
Read more >
How to import a csv file with special characters?
The problem is, when I go to file>import > follow the steps in the box and click finish, all the names with special...
Read more >
Remove, replace special characters when importing csv files ...
When importing data in csv format, some observations contain special characters as shown in the image below. ... I tried this code but...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found