this post was submitted on 05 Jul 2023
13 points (93.3% liked)
Linux
48145 readers
1048 users here now
From Wikipedia, the free encyclopedia
Linux is a family of open source Unix-like operating systems based on the Linux kernel, an operating system kernel first released on September 17, 1991 by Linus Torvalds. Linux is typically packaged in a Linux distribution (or distro for short).
Distributions include the Linux kernel and supporting system software and libraries, many of which are provided by the GNU Project. Many Linux distributions use the word "Linux" in their name, but the Free Software Foundation uses the name GNU/Linux to emphasize the importance of GNU software, causing some controversy.
Rules
- Posts must be relevant to operating systems running the Linux kernel. GNU/Linux or otherwise.
- No misinformation
- No NSFW content
- No hate speech, bigotry, etc
Related Communities
Community icon by Alpár-Etele Méder, licensed under CC BY 3.0
founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
@lily33 Yes. There are a number I believe that fit these criteria hosted on Hugging Face I feel. Bloom is the first one that came to mind.
Ironically I asked ChatGPT this question and it responded to check out EleutherAI. I do not know anything about that group but looks like they may have helped worked on Bloom, so maybe they are worthy of consideration. Anyway here is Bloom.
https://huggingface.co/blog/bloom-megatron-deepspeed
To add to this, here is another model that seems to aim to to be a poor man’s chatgpt: https://huggingface.co/togethercomputer/GPT-NeoXT-Chat-Base-20B
HuggingFace looks to me like it's a corporation. Like, when I click on "about > join us", I'm sent to their job offer page.
@lily33 like Github, HuggingFace is a private company that can host public models. I'm pretty sure this one is fully public. But you're right that it does look like someone from HF started it so perhaps it does not meet your criteria after all. My apologies if so.
I was (am?) of the understanding though that Bloom is being researched openly such that it can be reproduced locally (and contributed to on HF)