gpt3small is broken
See original GitHub issuegpt3small seems to have been left behind in some of our updates, and neither scripts/train_gpt3small.sh
nor scripts/train_gpt3small_pipeline.sh
run.
Issue Analytics
- State:
- Created 3 years ago
- Comments:6 (6 by maintainers)
Top Results From Across the Web
OpenAI's massive GPT-3 model is impressive, but size isn't ...
Last week, OpenAI published a paper detailing GPT-3, a machine learning model that achieves strong results on a number of natural language ...
Read more >Better not bigger: How to get GPT-3 quality at 0.1% the cost
A GPT-3 model fine-tuned on the Snorkel labeled dataset does no better than RoBERTa-base fine-tuned on the same data, despite being over 1400x ......
Read more >GPT-3, Bloviator: OpenAI's language generator has no idea ...
Its performance is unreliable, causal understanding is shaky, and incoherence is a constant companion. GPT-2 had problems with biological, ...
Read more >GPT-3 has no idea what it's talking about - Hacker News
The argument is that GPT3 has no understanding of the world, just superficial understanding of words and their relationships. If it did have...
Read more >Why GPT-3 Matters | Leo Gao
The sheer scale of the new GPT-3 model is hard to overstate; it's an entire order of magnitude larger than Microsoft's already-massive 17B ......
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
Have you checked out the Evaluation Harness? That is extremely important to both this project and other ones, and is more accessible to people who can write code but are newcomers to AI research. Each task that needs completing has an associated Issue.
On Wed, Jan 20, 2021 at 11:53 PM srulikbd notifications@github.com wrote:
ok, what I suspected. thanks! how can I help right now? I saw that we need kubernetes skills, so I’m learning it. anything else for a newcomer?