Comradeship // Freechat

2115 readers

1 users here now

Talk about whatever, respecting the rules established by Lemmygrad. Failing to comply with the rules will grant you a few warnings, insisting on breaking them will grant you a beautiful shiny banwall.

A community for comrades to chat and talk about whatever doesn't fit other communities

founded 3 years ago

MODERATORS

felipeforte@lemmygrad.ml

Would be interesting to have a Large Language Model fine-tuned on leftist sources (lemm.ee)

submitted 1 year ago by GodOfThunder@lemm.ee to c/comradeship@lemmygrad.ml

21 comments fedilink hide all child comments

It would be interesting to have a Large Language Model (LLM) fine-tuned on the ProleWiki and leftist books, as it could be very useful for debunking arguments related to leftist ideology. However, local models are not yet doing search and cited sources, which makes it difficult to trust them. With citations, it is possible to check if the model is referencing what it is citing or just making things up. The inclusion of citations would enable users to verify the references and ensure the model is accurately representing the sources it cites. In the future, when a local platform with search capabilities for LLMs becomes available, it would be interesting to prioritize leftist sources in the search results. Collaboratively curating a list of reliable leftist sources could facilitate this process. What are your thoughts on this?

you are viewing a single comment's thread
view the rest of the comments

[–] Comrade_Vig@lemmygrad.ml 11 points 1 year ago* (last edited 1 year ago) (1 children)

https://twitter.com/aakashg0/status/1667756466944770048

China made one called InternLM.

Guess what subjects it performs best on?

Mao culture and Marxism.

LLMs output what you put in.

In this case, the Chinese made a communist AI.

https://github.com/InternLM/InternLM

[–] AlbigensianGhoul@lemmygrad.ml 6 points 1 year ago* (last edited 1 year ago)

That looks fantastic, we could nudge the developers a bit and they'll likely know how to help out. Sadly I don't know any Chinese (yet), but nothing is too much of a hurdle for big nerds. The model is so big that HuggingFace was having trouble building it, but people can try it out here now. The English responses are alright and we could probably even just host it somewhere.

Pinging people who showed interest here: @rjs001@lemmygrad.ml, @Alunyanners@lemmygrad.ml, @comradeRichard@lemmygrad.ml, @RedWizard@lemmygrad.ml.