Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Supporting delimiters in vaex.open()

See original GitHub issue

Hi, does vaex not support other delimiters. This is the code that I ran : vaex.open('ap_final.CSV', delimiter='|')

and I got the following error:

OSError: Could not open file: ap_final.CSV, did you install vaex-hdf5? Is the format supported?

Even when I removed the delimiter argument, I got the same error. Please help. Urgent.

Issue Analytics

State:
Created 3 years ago
Comments:7 (4 by maintainers)

Top GitHub Comments

1reaction

JovanVeljanoskicommented, Jun 3, 2020

Hi,

I don’t understand why exactly, but in some (rare) cases it used to happen that pip would not install the latest version, so it does not hurt to check.

Sure, please check out the documentation pages at: https://docs.vaex.io/en/latest/

Also, if you are primarily interested in I/O, there is an example page just for that: https://docs.vaex.io/en/latest/example_io.html

Note that while vaex tries to keep close to the pandas API as much as possible, some method may be different (or have slightly different name).

So if you want to export data to CSV, the method is df.export_csv().

Note that vaex is optimal when using arrow or hdf5 files.

1reaction

JovanVeljanoskicommented, Jun 2, 2020

Hi,

If you are reading CSV files, might be better to use vaex.read_csv()...

which basically uses pandas to read the csv, and you can use the same arguments as you would use in pandas.read_csv.

Also please check that you are using the latest version of vaex.

Top Results From Across the Web

I/O Kung-Fu: get your data in and out of Vaex - vaex DataFrame

If your data is already in one of the supported binary file formats (HDF5, Apache Arrow, Apache Parquet, FITS), opening it with Vaex...

[BUG-REPORT] vaex.from_csv gets EmptyDataError on import ...

I have a small gzipped txt file, space delimited, that I try to import as a vaex dataframe WITHOUT allowing conversion into an...

Convert huge csv to hdf5 format - python - Stack Overflow

To diagnose, try testing with a small csv file and see if vaex.from_csv() works as expected. I suggest the lax_to_jfk.csv file.

How to use the vaex.open function in vaex - Snyk

To help you get started, we've selected a few vaex.open examples, based on popular ways it is ... #print dataset.full_length() #print len(dataset) if...

Python | Yun Gao - WordPress.com

Vaex is an open-source DataFrame library which enables the ... How to detect delimiter and encoding of CSV file in python/pandas.