Parquet write fails with DuckDB.dll 0.2.8
See original GitHub issueThanks for fixing the previous issue so quick. I have tried to write a parquet file and it throws this error: Catalog Error: Copy Function with name parquet does not exist! Did you mean “csv”?
It works on the CLI duckdb.exe, I haven’t found any doc stating that the C++ API does not support Parquet, so I don’t know if the issue is about your bindings or the Dll API itself.
using var conn = new DuckDBConnection("Data Source=:memory:");
try
{
conn.Open();
var command = conn.CreateCommand();
command.CommandText = "CREATE TABLE integers(foo INTEGER, bar INTEGER);";
var executeNonQuery = command.ExecuteNonQuery();
command.CommandText = "INSERT INTO integers VALUES (3, 4), (5, 6), (7, 8);";
executeNonQuery = command.ExecuteNonQuery();
command.CommandText = "SELECT foo, bar FROM integers";
var reader = command.ExecuteReader();
command.CommandText = "COPY (SELECT * FROM integers) TO 'result-snappy.parquet' (FORMAT 'parquet');";
executeNonQuery = command.ExecuteNonQuery();
}
catch (Exception ex)
{
Console.WriteLine(ex.Message);
}
Thanks for your effort bringing DuckDB to .NET!
Issue Analytics
- State:
- Created 2 years ago
- Comments:7 (5 by maintainers)
Top Results From Across the Web
Parquet - DuckDB
Parquet files are compressed columnar files that are efficient to load and process. They are typically produced from Spark, but can be produced...
Read more >OOM when reading Parquet file · Issue #3969 · duckdb ...
It is using all available memory and is terminated by OOM. To Reproduce. Allocate a machine with 32 GB RAM, like c6a.4xlarge on...
Read more >Create a parquet file from CSV represented as string using ...
I want to know how I can use duckdb ( https://duckdb.org/docs/data/parquet/overview.html ) to write a parquet file to the buffer in memory, ...
Read more >Apache Arrow 6.0.1 (2021-11-10)
ARROW-10126 - [Python] Impossible to import pyarrow module in python. Generates this “ImportError: DLL load failed: The specified procedure could not be found.” ......
Read more >Source - GitHub
... [C++][Parquet] Parquet Writer always puts null_count=0 in Parquet ... [R][CI] DuckDB tests fail on R < 4.0 ... [R] DuckDB has not...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Great news!! Thanks Sartorial, for your help on the duckdb repo!
Happy to help! I need it for a project I am working on right now.
On Sun, Nov 14, 2021 at 1:43 PM Marc Mauri @.***> wrote: