I have a silly little model I made for creating Vogoon poetry. One of the models is fed from Shakespeare. The system works by predicting the next letter rather than the next word (and whitespace is just another letter as far as it's concerned). Here's one from the Shakespeare generation:

KING RICHARD II:

Exetery in thine eyes spoke of aid.

Burkey, good my lord, good morrow now: my mother's said

This is silly nonsense, of course, and for its purpose, that's fine. That being said, as far as I can tell, "Exetery" is not an English word. Not even one of those made-up English words that Shakespeare created all the time. It's certainly not in the training dataset. However, it does sound like it might be something Shakespeare pulled out of his ass and expected his audience to understand through context, and that's interesting.

[–] WallEx@feddit.de 2 points 9 months ago (1 children)

Wow, sounds amazing, big probs to you! Are you planning on releasing the model? Would be interested tbh :D

[–] frezik@midwest.social 5 points 9 months ago (1 children)

Nothing special about it, really. I only followed this TensorFlow tutorial:

https://www.tensorflow.org/text/tutorials/text_generation

The Shakespeare dataset is on there. I also have another mode that uses entries from the Joyce Kilmer Memorial Bad Poetry Contest, and also some of the works of William Topaz McGonagall (who is basically the Tommy Wiseau of 19th century English poetry). The code is the same between them, however.

[–] WallEx@feddit.de 2 points 9 months ago

Nice, thx