tpWinthropeIII

joined 1 year ago
[–] tpWinthropeIII@lemmy.world 2 points 20 hours ago (1 children)

I know that people are using P40 and P100 GPUs. These are outdated but still work with some software stacks / applications. The P40 GPU, once very cheap for the amount of VRAM, is no longer as cheap as it was probably because folks have been picking them up for inference.

I'm getting a lot done with an NVidia GTX 1080 which only has 8GB VRAM. I can run a quant of dolphin Mixtral 7x8B and it works well enough. It takes minutes to load, almost too long for me, but after that I get 3-5 TPS with some acceptable delay between questions.

I can even run Miqu quants at 2 or 3 bits. It's super smart even at these low quant levels.

llama 3.1 8B runs great with this 1080 8BG GPU at 4_K_M and also 5 or 6_K_M. I believe I can run gemma 9B f16 at 8 bpw.

[–] tpWinthropeIII@lemmy.world 1 points 8 months ago

I installed it in Linux and it's headed for a live environment.

Starling looks good so far.

One improvement I'd recommend is to make links visible. They are currently the same color as general text in the chat, black by default. I'd recommend blue.

[–] tpWinthropeIII@lemmy.world 3 points 9 months ago (1 children)

The community can only read the source code, as of yet. All of the source code has been provided by a set of internal developers.

The fact that it is open source means that, if somehow two malware elements have made it into the source code, then someone will eventually report it. But this doesn't mean that two malware elements cannot be there right now.

These two malware hits on total virus scan should be communicated to the developers.

 

For NSFW images, in card mode where images are shown in full size, the default level of blur allows others to see the essence of the image. It would be nice to be able to increase the level of blur further. Perhaps three levels would be good.

[–] tpWinthropeIII@lemmy.world 2 points 10 months ago (1 children)

Locally, an attacker still needs to know your password. A strong password can make it too expensive or impractical to brute force.

[–] tpWinthropeIII@lemmy.world 2 points 10 months ago

Filen.io

Works well so far, is end to end encrypted, open source, and the apps are nice and solid.

[–] tpWinthropeIII@lemmy.world 2 points 11 months ago

Works great for me. I'm running mx23 after running mx19 for a few years.

I hope mx23 is better with updates, or making easier to update, as updates broke in mx19 not long after I first installed it. My only complaint. Otherwise great.

[–] tpWinthropeIII@lemmy.world 1 points 11 months ago (1 children)

Checking out !main@soccer.forum I saw very few posts by bots. Mainly saw posts by you. I saw one post coming from alien.top .

What's interesting is that only posts by bots have any comments. So maybe this could be a good way to get communities started.

Therefore, if it's okay with the admins at the following community, I'd nominate !tennis@lemmy.world

There's almost nothing happening there.

[–] tpWinthropeIII@lemmy.world 1 points 11 months ago

Did you check with the admins on lemmy first or are you bot posting without permission?

[–] tpWinthropeIII@lemmy.world 4 points 11 months ago (5 children)

Let's say I have a favorite sport and there exists a sub_ named: r/.

Let's also say there already exits a Lemmy community and that community is struggling to get off the ground: !@lemmy.world

I can see a value add if your project directly helps !@lemmy.world get started; but I don't see how it does. If anything wouldn't your project compete with !@lemmy.world and therefore hinder it?

It might be different if your project directly tied r/ to !@lemmy.world but it doesn't.

[–] tpWinthropeIII@lemmy.world 13 points 11 months ago (1 children)

If downvotes are the issue, beehaw.org doesn't allow downvotes. Those folks are automatically eliminated from that. You can then just ignore the comments you don't like and it's all good. 👍

[–] tpWinthropeIII@lemmy.world 1 points 1 year ago* (last edited 1 year ago) (1 children)

Testing feedback:

The links in this post don't load, https://feddit.nl/post/3654890

 

In the Fediverse, what is the solution to instances or servers going missing?

To elaborate: The problem with commercial aggregators like Reddit, Twitter/X, Facebook, etc. is enshitification, for one reason or another. Of course, Lemmy, etc. on the Fediverse is the alternative solution, seemingly. But let's say that the hardware for a large Lemmy instance just disappears. What happens to all of the posts? Yes, old posts will still be available for a while on other instances. But, seemingly, there won't be any more updates. How is this addressed?

Moderators would of course be interested in continuing but they may not have the skills and resources to set up the hardware.

Instances/servers can disappear for many reasons: retirement, illness, confiscation, war, bungee jumping or parachuting accident, ... the list goes on.

view more: next ›