Lightrun
question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Excessive amounts of indexing requests with many entities

See original GitHub issue

Description When creating many entities in succession, the indexing becomes very slow after about 20 entities.

The context where this bug occured is when creating seeds through the strapi entityService, i.e. about 100 articles one after the other.

I suspect that the bug is in the lifecycle hooks, i think in the following code in line 249 it seems like the lifecycles are registered recursively again and again on each execution of the lifecycle. But I am not sure.

https://github.com/meilisearch/strapi-plugin-meilisearch/blob/6fe6f2fc0fa1a47a03daab84e1843a71db679b44/server/services/meilisearch/connector.js#L249

Expected behavior The submitted indexing should not take much longer than the creation in the database

Current behavior It basically halts after about 20 entries.

Screenshots or Logs If applicable, add screenshots or logs to help explain your problem.

Meilisearch docker stats:

CONTAINER ID   NAME          CPU %     MEM USAGE / LIMIT     MEM %     NET I/O          BLOCK I/O         PIDS
b9738f17773f   api-meili-1   88.73%    253.8MiB / 15.52GiB   1.60%     102MB / 46.7MB   27.8MB / 34.8GB   23

While indexing the logs of meilisearch (number of requests for the roughly doubles over time, not quite because the lifecycle registration takes some time):

Long logs ahead 
[2022-04-09T08:00:29Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/settings HTTP/1.1" 202 124 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.006133
[2022-04-09T08:00:29Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.004954
[2022-04-09T08:00:29Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 0, number_of_documents: 0 }
[2022-04-09T08:00:29Z INFO  actix_web::middleware::logger] 172.28.0.1 "GET /indexes HTTP/1.1" 200 144 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.000188
[2022-04-09T08:00:30Z INFO  actix_web::middleware::logger] 172.28.0.1 "GET /indexes/content/stats HTTP/1.1" 200 65 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.000339
[2022-04-09T08:00:38Z INFO  actix_web::middleware::logger] 172.28.0.1 "GET /indexes HTTP/1.1" 200 144 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.000303
[2022-04-09T08:00:46Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.003050
[2022-04-09T08:00:46Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 1 }
[2022-04-09T08:00:46Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.003712
[2022-04-09T08:00:46Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 2 }
[2022-04-09T08:00:46Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.004048
[2022-04-09T08:00:46Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.006067
[2022-04-09T08:00:46Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 3 }
[2022-04-09T08:00:46Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 3 }
[2022-04-09T08:00:46Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 125 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.002465
[2022-04-09T08:00:46Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 125 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.005497
[2022-04-09T08:00:46Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.010204
[2022-04-09T08:00:46Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 4 }
[2022-04-09T08:00:46Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 4 }
[2022-04-09T08:00:46Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 4 }
[2022-04-09T08:00:46Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.002273
[2022-04-09T08:00:46Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.002645
[2022-04-09T08:00:46Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.004813
[2022-04-09T08:00:46Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.005992
[2022-04-09T08:00:46Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.007086
[2022-04-09T08:00:46Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 5 }
[2022-04-09T08:00:46Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 5 }
[2022-04-09T08:00:46Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 5 }
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 5 }
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.002153
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.002585
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.002368
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.002230
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 5 }
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.004893
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.004565
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.005373
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.007471
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 6 }
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 6 }
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 6 }
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 6 }
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 6 }
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.004339
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.004411
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 125 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.004004
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.005251
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.004093
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.002567
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.002111
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 6 }
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.002541
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.004978
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.005474
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.004678
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.003158
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.010030
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 6 }
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 6 }
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 7 }
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 7 }
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 7 }
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 7 }
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 7 }
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 7 }
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.002168
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.002228
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.002375
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 7 }
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.003204
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.003854
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.003581
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.004963
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.003733
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 7 }
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.003050
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.003029
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.004037
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.004087
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.003401
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 7 }
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.004178
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.003347
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.006329
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.008627
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.008355
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 7 }
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.015991
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.017767
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.015025
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 7 }
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 7 }
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 7 }
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 8 }
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 8 }
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 8 }
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 8 }
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 8 }
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.002139
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.003673
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 8 }
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.007001
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.010015
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.008979
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.005875
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.006174
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.006563
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.006936
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.008667
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.004242
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.008987
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.013862
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 8 }
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.014129
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.012462
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.010101
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.007924
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.007761
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.008009
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.008593
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.008949
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.008987
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.004372
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 8 }
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 125 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.031178
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.031235
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.026502
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.031356
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.031503
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.031511
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 125 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.031403
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.031678
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.031691
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.031802
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.031852
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 8 }
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 8 }
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 8 }
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 8 }
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 8 }
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 8 }
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 8 }
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 8 }
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 8 }
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 8 }
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 8 }
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.003488
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 8 }
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 125 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.006506
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.006281
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.006556
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 125 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.010671
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.008283
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.010611
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.010089
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.008987
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.008540
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.008363
[2022-04-09T08:00:47Z INFO  actix_web::middleware::logger] 172.28.0.1 "POST /indexes/content/documents HTTP/1.1" 202 126 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)" 0.009639
[2022-04-09T08:00:47Z INFO  meilisearch_lib::index::updates] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 8 }

After some time, this error is shown excessive amount of times (always the same id):

error: Meilisearch could not add entry with id: 369: Knex: Timeout acquiring a connection. The pool is probably full. Are you missing a .transacting(trx) call?

Then after cancelling, this error is shown excessive amount of times (always the same id):

error: Meilisearch could not add entry with id: 368: aborted

Environment:

  • OS: Manjaro
  • MeiliSearch version: v0.26.1
  • strapi-plugin-meilisearch version: v0.6.2
  • Browser: Firefox
  • Strapi version: v4.1.7

Issue Analytics

  • State:closed
  • Created a year ago
  • Reactions:1
  • Comments:6 (3 by maintainers)

github_iconTop GitHub Comments

1reaction
bidoubiwacommented, Apr 20, 2022

Hey @sargreal this is indeed an issue. I will have to try it out and re-create it. It may be linked to this issue meilisearch/strapi-plugin-meilisearch#384

I will need to try it out, thanks a lot for your investigation.

0reactions
sargrealcommented, Apr 28, 2022

@bidoubiwa Yes #397 fixes the issue as expected! 🎉

The missing document also didn’t occur anymore, no Idea where that came from

Read more comments on GitHub >

github_iconTop Results From Across the Web

Efficient Querying - EF Core - Microsoft Learn
Querying efficiently is a vast subject, that covers subjects as wide-ranging as indexes, related entity loading strategies, and many others.
Read more >
node.js - Elasticsearch 429 Too Many Requests _bulk with ...
When the number of requests to the Elasticsearch cluster exceeds the bulk queue size (threadpool.bulk.queue_size), this bulk queue error ...
Read more >
Apache Solr: How to efficiently index large amounts of data?
Apache Solr provides means to search through indexed resources extremely quickly. The indexing process itself, however, can take a lot of time.
Read more >
Google Indexing API says that most of my pages are unindexed
Hi. I'm using google indexing API and when i choose “get status” from most of my pages i get this messege… ... “message”:...
Read more >
"Error Fetching Fields" "Request Entity Too Large" - Kibana
Greetings,. We have an elastic cluster containing 12 nodes and 1.4Tb of documents, daily indexed through a total of 7.5k shards.
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found
Previous page

Custom populate options per entity

Next page

Bulk Document Indexing