rho50

joined 1 year ago
[–] rho50@lemmy.nz 6 points 3 months ago

Power management is going to be a huge emerging issue with the deployment of transformer model inference to the edge.

I foresee some backpedaling from this idea that "one model can do everything". LLMs have their place, but sometimes a good old LSTM or CNN is a better choice.

[–] rho50@lemmy.nz 17 points 3 months ago

Yeah, this is actually a pretty great application for AI. It's local, privacy-preserving and genuinely useful for an underserved demographic.

One of the most wholesome and actually useful applications for LLMs/CLIP that I've seen.

[–] rho50@lemmy.nz 13 points 3 months ago (3 children)

(6.9-4.2)/(2024-2018) = 0.45 "version increments" per year.

4.2/(2018-1991) = 0.15 "version increments" per year.

So, the pace of version increases in the past 6 years has been around triple the average from the previous 27 years, since Linux' first release.

I guess I can see why 6.9 would seem pretty dramatic for long-time Linux users.

I wonder whether development has actually accelerated, or if this is just a change in the approach to the release/versioning process.

[–] rho50@lemmy.nz 12 points 5 months ago* (last edited 5 months ago) (1 children)

I don't think it's necessarily a bad thing that an AI got it wrong.

I think the bigger issue is why the AI model got it wrong. It got the diagnosis wrong because it is a language model and is fundamentally not fit for use as a diagnostic tool. Not even a screening/aid tool for physicians.

There are AI tools designed for medical diagnoses, and those are indeed a major value-add for patients and physicians.

[–] rho50@lemmy.nz 1 points 5 months ago (1 children)

Precisely. Many of the narrowly scoped solutions work really well, too (for what they're advertised for).

As of today though, they're nowhere near reliable enough to replace doctors, and any breakthrough on that front is very unlikely to be a language model IMO.

[–] rho50@lemmy.nz 6 points 5 months ago

Exactly. So the organisations creating and serving these models need to be clearer about the fact that they're not general purpose intelligence, and are in fact contextual language generators.

I've seen demos of the models used as actual diagnostic aids, and they're not LLMs (plus require a doctor to verify the result).

[–] rho50@lemmy.nz 27 points 5 months ago (10 children)

There are some very impressive AI/ML technologies that are already in use as part of existing medical software systems (think: a model that highlights suspicious areas on an MRI, or even suggests differential diagnoses). Further, other models have been built and demonstrated to perform extremely well on sample datasets.

Funnily enough, those systems aren't using language models 🙄

(There is Google's Med-PaLM, but I suspect it wasn't very useful in practice, which is why we haven't heard anything since the original announcement.)

[–] rho50@lemmy.nz 89 points 5 months ago (6 children)

It is quite terrifying that people think these unoriginal and inaccurate regurgitators of internet knowledge, with no concept of or heuristic for correctness... are somehow an authority on anything.

[–] rho50@lemmy.nz 25 points 5 months ago (3 children)

I know of at least one other case in my social network where GPT-4 identified a gas bubble in someone's large bowel as "likely to be an aggressive malignancy." Leading to said person fully expecting they'd be dead by July, when in fact they were perfectly healthy.

These things are not ready for primetime, and certainly not capable of doing the stuff that most people think they are.

The misinformation is causing real harm.

[–] rho50@lemmy.nz 3 points 5 months ago

Ohh, my bad! I thought the person you were replying to was asking about Gitea. Yeah, Forgejo seems truly free and also looks like it has a strong governance structure that is likely to keep things that way.

[–] rho50@lemmy.nz 3 points 5 months ago (2 children)

This sadly isn't true anymore - they now have Gitea Enterprise, which contains additional features not available in the open source version.

[–] rho50@lemmy.nz 5 points 5 months ago

From here:

  • SAML
  • Branch protection for organizations
  • Dependency scanning (yes, there are other tools for this, but it's still a feature the open source version doesn't get).
  • Additional security controls for users (IP allowlisting, mandatory MFA)
  • Audit logging
 

I'm currently trying to build out a ZFS array with a few 8TB drives I have lying around. I have one of these 5-port NVMe SATA controllers and am looking for advice on which SFF PC to buy.

I had a spare NUC that I thought had a NVMe slot, but turns out it's SATA only.

Does anyone have any recommendations for reasonably cheap (second hand is fine) machines that would have: gigabit ethernet, USB3.0+, M.2 slot that supports NVMe?

Thanks in advance!

view more: next ›