question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Parquet write fails with DuckDB.dll 0.2.8

See original GitHub issue

Thanks for fixing the previous issue so quick. I have tried to write a parquet file and it throws this error: Catalog Error: Copy Function with name parquet does not exist! Did you mean “csv”?

It works on the CLI duckdb.exe, I haven’t found any doc stating that the C++ API does not support Parquet, so I don’t know if the issue is about your bindings or the Dll API itself.

using var conn = new DuckDBConnection("Data Source=:memory:");
try
{
    conn.Open();
    var command = conn.CreateCommand();

    command.CommandText = "CREATE TABLE integers(foo INTEGER, bar INTEGER);";
    var executeNonQuery = command.ExecuteNonQuery();

    command.CommandText = "INSERT INTO integers VALUES (3, 4), (5, 6), (7, 8);";
    executeNonQuery = command.ExecuteNonQuery();

    command.CommandText = "SELECT foo, bar FROM integers";
    var reader = command.ExecuteReader();

    command.CommandText = "COPY (SELECT * FROM integers) TO 'result-snappy.parquet' (FORMAT 'parquet');";
    executeNonQuery = command.ExecuteNonQuery();
}
catch (Exception ex)
{
    Console.WriteLine(ex.Message);
}

Thanks for your effort bringing DuckDB to .NET!

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:7 (5 by maintainers)

github_iconTop GitHub Comments

1reaction
mmauricommented, Nov 14, 2021

Great news!! Thanks Sartorial, for your help on the duckdb repo!

0reactions
SartorialOffensecommented, Nov 15, 2021

Happy to help! I need it for a project I am working on right now.

On Sun, Nov 14, 2021 at 1:43 PM Marc Mauri @.***> wrote:

Great news!! Thanks Sartorial, for your help on the duckdb repo!

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/Giorgi/DuckDB.NET/issues/13#issuecomment-968351746, or unsubscribe https://github.com/notifications/unsubscribe-auth/AC2Z5OSTZIXXVZ77H62HE7LUMAGOXANCNFSM5DNE4LLQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Parquet - DuckDB
Parquet files are compressed columnar files that are efficient to load and process. They are typically produced from Spark, but can be produced...
Read more >
OOM when reading Parquet file · Issue #3969 · duckdb ...
It is using all available memory and is terminated by OOM. To Reproduce. Allocate a machine with 32 GB RAM, like c6a.4xlarge on...
Read more >
Create a parquet file from CSV represented as string using ...
I want to know how I can use duckdb ( https://duckdb.org/docs/data/parquet/overview.html ) to write a parquet file to the buffer in memory, ...
Read more >
Apache Arrow 6.0.1 (2021-11-10)
ARROW-10126 - [Python] Impossible to import pyarrow module in python. Generates this “ImportError: DLL load failed: The specified procedure could not be found.” ......
Read more >
Source - GitHub
... [C++][Parquet] Parquet Writer always puts null_count=0 in Parquet ... [R][CI] DuckDB tests fail on R < 4.0 ... [R] DuckDB has not...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found