LocalLLaMA

2244 readers

1 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 1 year ago

MODERATORS

SkySyrup@sh.itjust.works

pax@sh.itjust.works

noneabove1182@sh.itjust.works

Mistral releases version 0.2 of their 7B model (mistral.ai)

submitted 11 months ago by noneabove1182@sh.itjust.works to c/localllama@sh.itjust.works

5 comments fedilink hide all child comments

Available in instruct only currently:

https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2

you are viewing a single comment's thread
view the rest of the comments

[–] noneabove1182@sh.itjust.works 3 points 11 months ago (1 children)

It's definitely a little odd.. I'm glad they did any kind of official release for 0.2, but yeah information is sorely lacking and would be nice to have more, especially with how revolutionary the previous one was.. is this incremental? Is it a huge change? Is it just more fine tuning? Did they start from scratch? We'll never know 🤷‍♂️

[–] rufus@discuss.tchncs.de 1 points 11 months ago* (last edited 11 months ago)

Hmmh. I've complained before how Mistral's use of the word 'open' differs quite a bit from my understanding. I mean, I wouldn't care if their models weren't that good and had the impact they have... But I'd really like to know what they updated, what kind of datasets went into Mistral, which languages it speaks... And they're definitely being 'odd'. All the other big players publish the safety evaluations like on biases, truthfulness, ... Just Mistral likes to be intransparent and not tell us anything.

Relevant discussion (without answers): https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2/discussions/2