GPT-J
Sign in to saveAlso known as GPT-J-6B
GPT-J or GPT-J-6B is an open-source large language model (LLM) developed by EleutherAI in 2021. As the name suggests, it is a generative pre-trained transformer model designed to produce human-like text that continues from a prompt. The optional "6B" in the name refers to the fact that it has 6 billion parameters. The model is available on GitHub, but the web interface no longer communicates with the model. Development stopped in 2021.
Key facts
- Software.logo
- EleutherAI logo.svg
- Software.logo_size
- 200px
- Software.logo caption
- Logo
- Software.developer
- EleutherAI
- Software.license
- Apache License 2.0
via Wikipedia infobox
Wikidata facts
- Instance of
- foundation model
- Named after
- generative pre-trained transformer
- Publisher
- EleutherAI
- Official website
- 6b.eleuther.ai
- Has use
- natural language processing
Show 1 more fact
- copyright license
- Apache Software License 2.0
Sources (2)
via Wikidata · CC0
~1 min read
Encyclopedic overview
2 sectionsContents
- Architecture
- References
GPT-J or GPT-J-6B is an open-source large language model (LLM) developed by EleutherAI in 2021. As the name suggests, it is a generative pre-trained transformer model designed to produce human-like text that continues from a prompt. The optional "6B" in the name refers to the fact that it has 6 billion parameters. The model is available on GitHub, but the web interface no longer communicates with the model. Development stopped in 2021.
==Architecture==
Excerpted from Wikipedia’s “GPT-J” article, available under the CC BY-SA 4.0 licence.