chaos

joined 1 year ago
[–] chaos@beehaw.org 2 points 3 days ago

That's not how it works at all. If it were as easy as adding a line of code that says "check for integrity" they would've done that already. Fundamentally, the way these models all work is you give them some text and they try to guess the next word. It's ultra autocomplete. If you feed it "I'm going to the grocery store to get some" then it'll respond "food: 32%, bread: 15%, milk: 13%" and so on.

They get these results by crunching a ton of numbers, and those numbers, called a model, were tuned by training. During training, they collect every scrap of human text they can get their hands on, feed bits of it to the model, then see what the model guesses. They compare the model's guess to the actual text, tweak the numbers slightly to make the model more likely to give the right answer and less likely to give the wrong answers, then do it again with more text. The tweaking is an automated process, just feeding the model as much text as possible, until eventually it gets shockingly good at predicting. When training is done, the numbers stop getting tweaked, and it will give the same answer to the same prompt every time.

Once you have the model, you can use it to generate responses. Feed it something like "Question: why is the sky blue? Answer:" and if the model has gotten even remotely good at its job of predicting words, the next word should be the start of an answer to the question. Maybe the top prediction is "The". Well, that's not much, but you can tack one of the model's predicted words to the end and do it again. "Question: why is the sky blue? Answer: The" and see what it predicts. Keep repeating until you decide you have enough words, or maybe you've trained the model to also be able to predict "end of response" and use that to decide when to stop. You can play with this process, for example, making it more or less random. If you always take the top prediction you'll get perfectly consistent answers to the same prompt every time, but they'll be predictable and boring. You can instead pick based on the probabilities you get back from the model and get more variety. You can "increase the temperature" of that and intentionally choose unlikely answers more often than the model expects, which will make the response more varied but will eventually devolve into nonsense if you crank it up too high. Etc, etc. That's why even though the model is unchanging and gives the same word probabilities to the same input, you can get different answers in the text it gives back.

Note that there's nothing in here about accuracy, or sources, or thinking, or hallucinations, anything. The model doesn't know whether it's saying things that are real or fiction. It's literally a gigantic unchanging matrix of numbers. It's not even really "saying" things at all. It's just tossing out possible words, something else is picking from that list, and then the result is being fed back in for more words. To be clear, it's really good at this job, and can do some eerily human things, like mixing two concepts together, in a way that computers have never been able to do before. But it was never trained to reason, it wasn't trained to recognize that it's saying something untrue, or that it has little knowledge of a subject, or that it is saying something dangerous. It was trained to predict words.

At best, what they do with these things is prepend your questions with instructions, trying to guide the model to respond a certain way. So you'll type in "how do I make my own fireworks?" but the model will be given "You are a chatbot AI. You are polite and helpful, but you do not give dangerous advice. The user's question is: how do I make my own fireworks? Your answer:" and hopefully the instructions make the most likely answer something like "that's dangerous, I'm not discussing it." It's still not really thinking, though.

[–] chaos@beehaw.org 23 points 6 days ago

Homophobia and transphobia, when you dig into them a bit, are often based in a fear that they'll be on the other end of toxic masculinity instead of the one they're used to.

[–] chaos@beehaw.org 10 points 1 month ago

Archive Team often uses the Internet Archive to share the things they save and obviously they have a shared goal of saving a copy of everything ever made, but they aren't the same people. The Archive Team is a vigilante white hat hacker group (well, maybe a little bit grey), and running a Warrior basically means you're volunteering to be part of their botnet. When a website is going to be shut down, they'll whip together a script and push it out to the botnet to try to grab as much of the dying site as they can, and when there's more downtime they have some other projects, like trying to brute force all those awful link shorteners so that when they inevitably die, people can still figure out where it should've pointed to.

[–] chaos@beehaw.org 10 points 1 month ago

This, and see also "minmaxing," the process of optimizing something (usually your character in a game) to get minimum penalty and/or maximum benefit, usually ignoring anything like realism or storytelling and focusing entirely on the stats and numbers.

[–] chaos@beehaw.org 9 points 1 month ago

The .bin and .cue file are the parts of the actual game disc that you want. The .bin file contains almost all of the data and the .cue file contains some extra information about the structure of the CD. All the rest is Internet Archive stuff (and an image of the game cover of course).

To open it, you can convert it to a .iso disk image instead, which any Linux distribution can open as if it were a real CD. This blog post talks about how to do that. The last paragraph about mount you can probably replace with double-clicking the .iso file in the GUI I would guess.

[–] chaos@beehaw.org 5 points 1 month ago (1 children)

I know TiddlyWiki quite well but have only poked at Logseq, so maybe it's more similar to this than I think, but TiddlyWiki is almost entirely implemented in itself. There's a very small core that's JavaScript but most of it is implemented as wiki objects (they call them "tiddlers," yes, really) and almost everything you interact with can be tweaked, overridden, or imitated. There's almost nothing that "the system" can do but you can't. It's idiosyncratic, kind of its own little universe to be learned and concepts to be understood, but if you do it's insanely flexible.

Dig deep enough, and you'll discover that it's not a weird little wiki — it's a tiny, self-contained object database and web frontend framework that they have used to make a weird little wiki, but you can use it for pretty much anything else you want, either on top of the wiki or tearing it down to build your own thing. I've used it to make a prediction tracker for a podcast I follow, I've made my own todo list app in it, and I made a Super Bowl prop bet game for friends to play that used to be spreadsheet-based. For me, it's the perfect "I just want to knock something together as a simple web app" tool.

And it has the fun party trick (this used to be the whole point of it but I'd argue it has moved beyond this now) that your entire wiki can be exported to a single HTML file that contains the entire fully functional app, even allowing people to make their own edits and save a new copy of the HTML file with new contents. If running a small web server isn't an issue, that's the easiest way to do it because saving is automatic and everything is centralized, otherwise you need to jump through some hoops to get your web browser to allow writing to the HTML file on disk or just save new copies every time.

[–] chaos@beehaw.org 5 points 1 month ago* (last edited 1 month ago) (1 children)

If you run the Node.js version, that's all handled for you. It's only if you want to do the party trick of keeping it all in a single HTML file that you need to worry about a plugin or anything like that. And even then, the server version exports to a standalone HTML file with one or two clicks.

Edit to add: it's the only substantial Node package I've ever seen with zero dependencies. Very lightweight and simple to run.

[–] chaos@beehaw.org 12 points 1 month ago (1 children)

No. The headsets are disabled when the play starts or when the play clock goes below 15 seconds.

[–] chaos@beehaw.org -1 points 2 months ago (1 children)

It's not a fantasy because they're bad ideas (they're not) or we shouldn't fight for them (we should), it's a fantasy because you're skipping over any of the actual work that needs to be done to make them happen: convincing more people to join you and demand more. Ask 100 people if the Senate and Supreme Court should be abolished and 99 of them are going to look at you like you have two heads. You can insist that you're right and they're all wrong all you want, but unless you work to get more people on your side, you'll just be complaining into the void and setting impossible standards for politicians so that you can feel smug when they fail to meet them.

[–] chaos@beehaw.org 6 points 2 months ago

It's a new model this year, as Nate Silver took his with him when he left 538. The new one seems to put a lot of emphasis on "the fundamentals" this far out, that is, it "thinks" that the general environment and economy and such is pretty good for the incumbent and that the polls might move in that direction by the time election day comes along. And since it's fitted to historical data, it's also implicitly assuming that this election will be similar to past elections (like, say, including a competent campaign by a candidate who can get out there and effectively communicate accomplishments and a plan for their term).

I personally think those assumptions are pretty clearly wrong this year and so I'm more inclined to base my perception of the race on pure polling averages, which are looking quite bad for Biden.

[–] chaos@beehaw.org 4 points 2 months ago

"The US President might be in cognitive decline" is a massive news story, as is "The only opponent to a fascist is one more bad night away from his campaign completely imploding," and also "the President's own party says behind closed doors that he's in massive trouble, but is sticking with him in public."

[–] chaos@beehaw.org 2 points 3 months ago (1 children)

If a minority group is being oppressed or is otherwise motivated to create change and is voting in large numbers, but the majority is apathetic and not bothering to vote, then this system would prevent the minority from changing their representation as "punishment" for something they're not doing.

It's also a bit of a "the beatings will continue until morale improves" solution to the problem, if it even is actually a problem. Low turnout is bad, but not because it's inherently bad not to vote. It's a symptom of the fact that people don't think it matters, or that it will change anything, and unfortunately they're not exactly wrong much of the time. Instead of putting effort into punishing people for not being engaged enough, it'd be better to make systemic changes that empower people and make the government more representative of their interests.

view more: next ›