question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

gpt3small is broken

See original GitHub issue

gpt3small seems to have been left behind in some of our updates, and neither scripts/train_gpt3small.sh nor scripts/train_gpt3small_pipeline.sh run.

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Comments:6 (6 by maintainers)

github_iconTop GitHub Comments

1reaction
StellaAthenacommented, Jan 21, 2021

Have you checked out the Evaluation Harness? That is extremely important to both this project and other ones, and is more accessible to people who can write code but are newcomers to AI research. Each task that needs completing has an associated Issue.

On Wed, Jan 20, 2021 at 11:53 PM srulikbd notifications@github.com wrote:

ok, what I suspected. thanks! how can I help right now? I saw that we need kubernetes skills, so I’m learning it. anything else for a newcomer?

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub https://github.com/EleutherAI/gpt-neox/issues/71#issuecomment-764311425, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADZJVMBE72SG77DM3M7KYG3S26XMFANCNFSM4WHTG4SA .

0reactions
srulikbdcommented, Jan 21, 2021

ok, what I suspected. thanks! how can I help right now? I saw that we need kubernetes skills, so I’m learning it. anything else for a newcomer?

Read more comments on GitHub >

github_iconTop Results From Across the Web

OpenAI's massive GPT-3 model is impressive, but size isn't ...
Last week, OpenAI published a paper detailing GPT-3, a machine learning model that achieves strong results on a number of natural language ...
Read more >
Better not bigger: How to get GPT-3 quality at 0.1% the cost
A GPT-3 model fine-tuned on the Snorkel labeled dataset does no better than RoBERTa-base fine-tuned on the same data, despite being over 1400x ......
Read more >
GPT-3, Bloviator: OpenAI's language generator has no idea ...
Its performance is unreliable, causal understanding is shaky, and incoherence is a constant companion. GPT-2 had problems with biological, ...
Read more >
GPT-3 has no idea what it's talking about - Hacker News
The argument is that GPT3 has no understanding of the world, just superficial understanding of words and their relationships. If it did have...
Read more >
Why GPT-3 Matters | Leo Gao
The sheer scale of the new GPT-3 model is hard to overstate; it's an entire order of magnitude larger than Microsoft's already-massive 17B ......
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found