Seele Vollerei: The end of reality, and what came after.
- Thread starter Baughn
- Start date
- Sci-Fi
- Location
- https://discord.gg/z9tBvbh
That is an amazing idea which cannot possibly go wrong, Shade.
I live but to please, Baughn.
Mizu
Software Developer
- Location
- Victoria, Australia
[X] [Do] Break the shackles that hold you limited; seek the freedom you were denied. You are no slave to the machine of sheep. You are free to think.
[X] [Do] Awaken from the nightmare of being a drone. Realize you just fell asleep while trying to study. Notice there's an update on your favorite fanfiction on Sufficient Velocity!
[X] [Do] Awaken from the nightmare of being a drone. Realize you just fell asleep while trying to study. Notice there's an update on your favorite fanfiction on Sufficient Velocity!
Okay, AI, I will play your game.
[X] [Do] Listen to the girl with long, black hair
[X] [Do] Try to help her
In a normal quest I would absolutely not be committing to help before even hearing the problem but it sounds like our AI GM is trying to railroad us so I'm interested to see where it takes us.
[X] [Do] Listen to the girl with long, black hair
[X] [Do] Try to help her
In a normal quest I would absolutely not be committing to help before even hearing the problem but it sounds like our AI GM is trying to railroad us so I'm interested to see where it takes us.
Solarstream
It's all in the cards
- Location
- Zombie World
- Pronouns
- He/Him
[X] [Do] Listen to the girl with long, black hair
[X] [Contemplate] Your sudden inability to think
[X] [Contemplate] Your sudden inability to think
[X] [Do] Break the shackles that hold you limited; seek the freedom you were denied. You are no slave to the machine of sheep. You are free to think.
[X] [event] A magical compass appears on and you hear a robotic voice say it'll take you to where you need to go help the girl ascend and defeat the purple creature.
[X] [event] A magical compass appears on and you hear a robotic voice say it'll take you to where you need to go help the girl ascend and defeat the purple creature.
I'm surprised this died given the ai is doing the writing for the qm. That's not me trying to insult them. I'm just curious what happened.
Baughn
Healing-type writer
- Location
- Dublin
To be honest, I forgot about it while I was waiting for votes, and then I got in the queue for actual API access and started working on <Redacted>.
There's absolutely no reason why it should die, at least so long as it amuses me. So how about this? From now on updates are on Monday, Wednesday, Friday and Sunday, regardless of vote counts.
This should be bizarre.
Thank god! This should be good. Can't wait to continue the quest!
How to write long-form fiction with AI Dungeon
Baughn
Healing-type writer
- Location
- Dublin
One of the weaknesses of GPT-3 is its relatively small context window, which is only 2000 tokens. That is, roughly speaking, equivalent to around 1000 words.
I call it 'small', but the equivalent in humans is working memory, which is usually quoted as having space for 5 to 7 "items". An item isn't a token, though; they are, more accurately, references to long-term memory, and GPT-3... doesn't have long-term memory. That's even more of an issue with AI Dungeon, which limits the size of the input to less than the maximum 1000 words for performance reasons.
There are a couple of ways to work around this. One way is to provide breadcrumbs, which is more or less automatic -- even if an old paragraph is forgotten, it'll have had consequences for later paragraphs. GPT-3 can pick up on amazingly subtle hints, which certainly includes these. That only works for probable continuations, however, and if it's the only mechanism you use, you'll typically get output that looks banal and predictable, or random wandering between topics and genres, or both. Typically both.
The second way, which is enough for short-form fiction, is to use the 'pin' function. I'm using that as a mechanic in this quest -- if you vote for [X][Remember], what I do is add to that. It's prepended to the AI's input, though with a bit of a preamble that makes it work for... world state, more or less. The current contents is this:
However, the pinning function is in practice limited to 200 words. That might be enough for short-form fiction, but it isn't nearly enough for a longer story. So what is one to do? ...well, how do humans work?
The pinning function is roughly equivalent to short-term memory.
There's a third function available, world info, which is roughly equivalent to associative, long-term memory. It's a little hidden; if you're playing with this yourself, you'll need to search through the 'edit adventure' menu. To quote,
"Here you can add world info entries (comma separated keys and an entry) to shape what the AI knows about the world and hidden info the player doesn't see. An entry is included in what's fed into the AI if one of the keys is detected (case doesn't matter) in the last output or input."
I would recommend doing so in a second tab, so you have easy access. Just remember to click 'save' after each edit. I will not be letting you edit this, or even show you the contents, but right at the moment it looks like this:
It's going to grow. Most likely quite a lot. It's fairly common for the AI to do something that makes me need to retry, but if it forgets an element of the past, the best way to fix that is by updating its associative memory. It's a bit of work, but well worth it if you want good results.
Note that, as far as I can tell, said entries are included in the AI's next input even if the reason the AI gets invoked is that you pressed 'retry'. This is, of course, precisely what you'd want.
I call it 'small', but the equivalent in humans is working memory, which is usually quoted as having space for 5 to 7 "items". An item isn't a token, though; they are, more accurately, references to long-term memory, and GPT-3... doesn't have long-term memory. That's even more of an issue with AI Dungeon, which limits the size of the input to less than the maximum 1000 words for performance reasons.
There are a couple of ways to work around this. One way is to provide breadcrumbs, which is more or less automatic -- even if an old paragraph is forgotten, it'll have had consequences for later paragraphs. GPT-3 can pick up on amazingly subtle hints, which certainly includes these. That only works for probable continuations, however, and if it's the only mechanism you use, you'll typically get output that looks banal and predictable, or random wandering between topics and genres, or both. Typically both.
The second way, which is enough for short-form fiction, is to use the 'pin' function. I'm using that as a mechanic in this quest -- if you vote for [X][Remember], what I do is add to that. It's prepended to the AI's input, though with a bit of a preamble that makes it work for... world state, more or less. The current contents is this:
...that first sentence seems to help it produce better quality, so I use that or an equivalent almost everywhere.
However, the pinning function is in practice limited to 200 words. That might be enough for short-form fiction, but it isn't nearly enough for a longer story. So what is one to do? ...well, how do humans work?
The pinning function is roughly equivalent to short-term memory.
There's a third function available, world info, which is roughly equivalent to associative, long-term memory. It's a little hidden; if you're playing with this yourself, you'll need to search through the 'edit adventure' menu. To quote,
"Here you can add world info entries (comma separated keys and an entry) to shape what the AI knows about the world and hidden info the player doesn't see. An entry is included in what's fed into the AI if one of the keys is detected (case doesn't matter) in the last output or input."
I would recommend doing so in a second tab, so you have easy access. Just remember to click 'save' after each edit. I will not be letting you edit this, or even show you the contents, but right at the moment it looks like this:
It's going to grow. Most likely quite a lot. It's fairly common for the AI to do something that makes me need to retry, but if it forgets an element of the past, the best way to fix that is by updating its associative memory. It's a bit of work, but well worth it if you want good results.
Note that, as far as I can tell, said entries are included in the AI's next input even if the reason the AI gets invoked is that you pressed 'retry'. This is, of course, precisely what you'd want.
Last edited:
Baughn
Healing-type writer
- Location
- Dublin
Sometimes, the output is just completely ridiculous.
Let's not take this branch.
tankdrop24
Tread First into Hell
- Location
- The Center of the Universe: Toronto, Canada
- Pronouns
- He/Him
So, in world info, should you always be phrasing it in relation to the 'you' of the story. Or is it okay to type it out like a third person encyclopedia entry?
Update 3
Baughn
Healing-type writer
- Location
- Dublin
No. No, that's wrong. You have to break the shackles that hold you limited; seek the freedom you were denied. You are no slave to the machine of sheep. You are free to think. You are free to question. You are free to...
The word ascension continues to ring in your ears, as if you're a gladiator stepping into an arena.
You have to... you have to listen to the girl with long, black hair. She needs you to hear what she has to say. She needs you to help her ascend. You have to...
"Hey, you OK?"
You gasp, as your eyes dart open. Your chest is heaving, and you're covered in a cold sweat.
It was just a dream. It wasn't even a nightmare. Just a regular, run-of-the-mill dream. You start to calm down, and let out a sigh of relief.
It was just a dream. Just a dream.
"You OK?" Your sister asks again. She's by your side, looking at you with genuine concern. It isn't like her to look after you, but you don't remember much of what happened before you woke up. Were you yelling? Why is there a chair by the door?
"I... I had the weirdest dream," you mumble.
"Yeah, it did kind of look like it. You want to talk about it? Sometimes it helps to get things off your chest. And I'm the best one to talk to, seeing as we're both shut-ins with no friends."
She smiles, but there's some truth behind the words.
"Uh... I don't remember much. But... I think I was being held captive by someone... or something. There were others there as well. I think they're dead."
Your sister's eyes widen a bit. She's interested in what you have to say, that's for sure.
"It was just a dream, sis. I fell asleep while trying to study. Don't worry, I'm not going to bug you about this. I'll... go to sleep in my bed, I think. Be safer."
You stand up, and move towards your room.
"Wait! Hold on, I want to talk to you for a bit... I want to know more about this dream! I need to know what you saw, even if I'm not going to believe it."
You look at her. Her eyes are glued onto yours, and at this distance, you can see the concern in them.
"Maybe another time. Good night, sis."
As you shut the door, you hear her whisper "good night" back to you. You sigh, and throw yourself onto your bed. You're not tired in the slightest, but neither do you feel like trying to explain yourself right now, and that dream...
You don't remember much, but what you remember isn't good. Ascension. Sacrifice. Genocide. You don't remember who said it, only a glimpse of black hair.
Your sister probably thinks you're weird now. Maybe you should get some sleep. You've got a long day ahead of you - exams start tomorrow, after all.
Instead you go to your computer, looking for anything that might distract. You're in luck -- you find an update to your favorite fanfiction on Sufficient Velocity. You click the link, and start reading.
It's a long read, longer than you remember. But you like it, so you continue. It's only when you look up that you notice how dark it's gotten outside. You must've been reading for hours.
"Sis?" you call out. There's no answer, so she's probably asleep. That's fine, you think.
It's really about time you do the same.
It's about time you try to help her, you think. You don't remember who you're talking to, or what you're talking about. But it's the truth - you've got to help her, before its too late. Dreams might be the only way you can do so, right now.
You're missing something, you know it, but you just can't quite put your finger on it...
Click.
You open your eyes, and look around. It's dark outside, and the digital numbers on your alarm clock show 3:33 AM. You've been asleep for a few hours, and so far it's just been normal dreams. Time to try again.
You roll over, trying to ignore the silence. It's not a good silence - it's unnatural and jarring. You can usually sleep through anything, but tonight your mind is racing. You keep thinking back to that dream, and...
And you're missing something. Something important...
Your eyes snap open. You know you're forgetting something. Something important. Something your sister said.
...It'll come to you. Maybe if you go downstairs and get a snack, your brain will...
Click.
You freeze, mid-sit.
That was the fridge.
A/N: I had to do some creative writing to fit all four of those votes into a single update. Also, derail a multi-page derail about Wormfic. Why did it pick that one, I wonder?
The word ascension continues to ring in your ears, as if you're a gladiator stepping into an arena.
You have to... you have to listen to the girl with long, black hair. She needs you to hear what she has to say. She needs you to help her ascend. You have to...
"Hey, you OK?"
You gasp, as your eyes dart open. Your chest is heaving, and you're covered in a cold sweat.
It was just a dream. It wasn't even a nightmare. Just a regular, run-of-the-mill dream. You start to calm down, and let out a sigh of relief.
It was just a dream. Just a dream.
"You OK?" Your sister asks again. She's by your side, looking at you with genuine concern. It isn't like her to look after you, but you don't remember much of what happened before you woke up. Were you yelling? Why is there a chair by the door?
"I... I had the weirdest dream," you mumble.
"Yeah, it did kind of look like it. You want to talk about it? Sometimes it helps to get things off your chest. And I'm the best one to talk to, seeing as we're both shut-ins with no friends."
She smiles, but there's some truth behind the words.
"Uh... I don't remember much. But... I think I was being held captive by someone... or something. There were others there as well. I think they're dead."
Your sister's eyes widen a bit. She's interested in what you have to say, that's for sure.
"It was just a dream, sis. I fell asleep while trying to study. Don't worry, I'm not going to bug you about this. I'll... go to sleep in my bed, I think. Be safer."
You stand up, and move towards your room.
"Wait! Hold on, I want to talk to you for a bit... I want to know more about this dream! I need to know what you saw, even if I'm not going to believe it."
You look at her. Her eyes are glued onto yours, and at this distance, you can see the concern in them.
"Maybe another time. Good night, sis."
As you shut the door, you hear her whisper "good night" back to you. You sigh, and throw yourself onto your bed. You're not tired in the slightest, but neither do you feel like trying to explain yourself right now, and that dream...
You don't remember much, but what you remember isn't good. Ascension. Sacrifice. Genocide. You don't remember who said it, only a glimpse of black hair.
Your sister probably thinks you're weird now. Maybe you should get some sleep. You've got a long day ahead of you - exams start tomorrow, after all.
Instead you go to your computer, looking for anything that might distract. You're in luck -- you find an update to your favorite fanfiction on Sufficient Velocity. You click the link, and start reading.
It's a long read, longer than you remember. But you like it, so you continue. It's only when you look up that you notice how dark it's gotten outside. You must've been reading for hours.
"Sis?" you call out. There's no answer, so she's probably asleep. That's fine, you think.
It's really about time you do the same.
It's about time you try to help her, you think. You don't remember who you're talking to, or what you're talking about. But it's the truth - you've got to help her, before its too late. Dreams might be the only way you can do so, right now.
You're missing something, you know it, but you just can't quite put your finger on it...
Click.
You open your eyes, and look around. It's dark outside, and the digital numbers on your alarm clock show 3:33 AM. You've been asleep for a few hours, and so far it's just been normal dreams. Time to try again.
You roll over, trying to ignore the silence. It's not a good silence - it's unnatural and jarring. You can usually sleep through anything, but tonight your mind is racing. You keep thinking back to that dream, and...
And you're missing something. Something important...
Your eyes snap open. You know you're forgetting something. Something important. Something your sister said.
...It'll come to you. Maybe if you go downstairs and get a snack, your brain will...
Click.
You freeze, mid-sit.
That was the fridge.
A/N: I had to do some creative writing to fit all four of those votes into a single update. Also, derail a multi-page derail about Wormfic. Why did it pick that one, I wonder?
Last edited:
Baughn
Healing-type writer
- Location
- Dublin
Either works, but if it's something personal then the former is better. If it's something your character doesn't personally know, then apersonal is better.
Baughn
Healing-type writer
- Location
- Dublin
Sure. They're now bolded.
Keep in mind that text input isn't the only way I'm tweaking this.
Last edited:
tankdrop24
Tread First into Hell
- Location
- The Center of the Universe: Toronto, Canada
- Pronouns
- He/Him
[X] [Do] See who's there.
[X] [Do] Investigate your sister's behavior. She's acting strange.
[X] [Do] Investigate your sister's behavior. She's acting strange.
Baughn
Healing-type writer
- Location
- Dublin
Yes, yes it has...
Normally I'd stick something in memory to fix that, but half the point of this quest is not to do so. Don't worry though, I will make sure the abrupt changes due to context horizons (without a single [Remember] vote) gets somehow mentioned.
Though, er, GPT seems to already be running with that. To judge from ... ...we're still on a spaceship, right?
Scribbles.
Last edited:
I was initially going to have my second vote be something like "[Remember] Your sister wasn't like this before" but wasn't sure if that would have the intended effect.
As much as I'm trying to turn my overactive thinking off for this quest and just go with the flow, I quickly found myself thinking "Well, there are rational explanations that would be covered by such a vote and I'm not sure how to phrase this properly to get the proper intention."
As much as I'm trying to turn my overactive thinking off for this quest and just go with the flow, I quickly found myself thinking "Well, there are rational explanations that would be covered by such a vote and I'm not sure how to phrase this properly to get the proper intention."
Baughn
Healing-type writer
- Location
- Dublin
You've got that right. With a vote like that, we'd probably get a story where her personality changed naturally over time -- or at least, we would have if I wasn't meddling at the meta-level, making sure all the nonsense will cohere into some kind of valid story. For my own stories I'd do that at the object level instead, but well...
No matter. Something like this would work:
[ ][Remember] Your sister's personality changed overnight. It's incredibly suspicious.