Can not build more than 101 pages with Next.js

What happened?

I clone markdoc’s Next.js starter demo, randomly add 97 markdom files to pages/docs/ folder, then run npm run build, and Next.js will stuck on info - Creating an optimized production build ... forever.

To reproduce

1. git clone https://github.com/markdoc/markdoc-starter
2. Add random markdown files to pages/docs/ folder like below:

const fs = require("fs");
for (let i = 0; i < 98; i++) {
  fs.writeFileSync(`./pages/docs/${i}.md`, `##${i}`);
}

1. npm run build
2. It will stuck on info - Creating an optimized production build ... forever.
3. Delete one markdown file from pages/docs/, and it will build successfully.
4. And then, without deleting .next folder, add some more markdown files to pages/docs/, will build successfully. But if you delete .next before adding more files, it will hang forever.

I try to refactor my blog using markdoc, then found this issue. Had tried several next versions and markdoc versions, no luck. I think it’s more likely markdoc related? Looking for help, thanks!

Version

try latest and older versions

Additional context

No response

[mfix-stripe]

Hey folks, sorry for the delay here. I dug into this deeper, and there is something weird going on within Webpack and/or Next.js that prevents us from importing a module more than a certain amount of times at once. The trouble is we don’t know that number ahead of time, nor are we able to stop if from hanging forever without introducing even worse behavior.

I fixed this issue here (https://github.com/markdoc/next.js/pull/19) by removing the build-time importModule call, which disables the Markdoc validation support we had previously included. If you want to validate all your content (for example in CI), you should call Markdoc.validate in a separate script.

I will release this fix on Monday.

Full validation was never supported in @markdoc/next.js so this shouldn’t break any applications.

As a follow up, I will open an issue that re-thinks build time schema validation for the Markdoc Nexts.js plugin.

[faustbrian]

You mean ulimit? Not aware of a command called limits.