node-postgres not being able to handle large inserts?

I am getting this error while executing a large transaction.

{ 
[error: bind message supplies 14472 parameters, but prepared statement "" requires 80008] 
}

1. I am inserting 10001 rows and each row has 8 columns.
2. I can confirm that I did supply all 80008 parameters but for some reason, I keep getting this bind message supplies 14472 parameters error
3. My work_mem is 1mb and maintenance_work_mem is 16mb

My resolution: I had to write the sql query into a file (‘insert.sql’) and then I went into postgres console and did \i insert.sql and then it was fine.

Note: With node-postgres, I use node-sql to generate prepared statements, however, when I did \i insert.sql I produced a raw sql statement.

Some guesses: Idea 1: Maybe because I am inserting so many rows at once that postgres dies after processing 14472 parameters?

I have had similar problems with node-postgres in the past where when I used node-postgres to do large inserts, it seemed not to be able to handle it well. And with large inserts I always resort back to \i insert.sql

[brianc]

Yeah I think it should be super cheap, can just do

if (params.length > 65535) {
  throw new Error('Postgres only supports up to 65535 parameters in a prepared statement')
}

[brianc]

The 16-bit hard cap on params is specified as part of the postgres protocol and is a constraint within postgres itself. Here’s the code that writes the count of params. This library could probably throw a friendlier error rather than just having the query crash with a param count mis-match…but it’s nothing that we can actually “fix” on our side.