chriswolfram/llamalink

llamalink's Issues

Text generation starts producing incoherent response

Note that it doesn't occur if you run the binary directly

In[8]:= tokens = LlamaTokenize[llama, "Once upon a time"];
Monitor[
  LlamaGenerate[llama, tokens, "MaxTokens" -> 2000, 
   HandlerFunctions -> <|"NewToken" -> (AppendTo[tokens, #] &)|>],
  LlamaDetokenize[llama, tokens]
  ];
LlamaDetokenize[llama, tokens]

Out[10]= "Once upon a time, there was a young boy named Max who loved \
to play his guitar. He would spend hours strumming away, trying to \
create the perfect melody. Max's parents were always supportive of \
his hobby, but they also wanted him to focus on his studies.

One day, Max's teacher announced that they would be having a big test \
the following week. Max was nervous, but he knew he had to study hard \
if he wanted to do well. He spent every spare moment reviewing his \
notes and practicing his guitar.

As the day of the test approached, Max's nerves started to get the \
best of him. He was worried that he wouldn't do well and that his \
parents would be disappointed in him. But then he remembered the \
lessons he had learned from playing his guitar.

Max knew that playing music had helped him develop a good sense of \
rhythm, pitch, and harmony. He also knew that it had taught him how \
to focus and pay attention to detail. These skills would come in \
handy during the test.

On the day of the test, Max arrived at school feeling confident and \
prepared. He sat down at his desk and began to work through the \
questions. To his surprise, he found that he was able to answer them \
quickly and accurately.

As he worked, Max noticed that some of his classmates were \
struggling. They seemed to be having trouble understanding the \
questions and staying focused. Max realized that they didn't have the \
same level of interest and dedication as he did when it came to their \
studies.

After the test was over, Max's teacher announced the results. Max had \
scored the highest in the class, earning an A+. His classmates were \
amazed and impressed. They asked him how he had done it.

Max explained that he had spent a lot of time practicing his guitar \
and developing his musical skills. He said that these skills had \
helped him stay focused and focused during the test. His classmates \
were amazed and inspired.

From that day on, Max's classmates started to take their studies more \
seriously. They realized that they needed to develop their own \
interests and passions if they wanted to succeed. Max continued to \
play his guitar and practice his music, knowing that it would help \
him in all areas of his life.

In the end, Max learned that tests and grades were important, but \
they weren't everything. He realized that it was his dedication and \
passion for music that had helped him succeed. And he knew that he \
would continue to pursue his love of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of for \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of for of of of of of of of \
of of of of of of of of of of of of of of for of of of of of of of of \
of of of of of of of of of of for of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of of of of of of of of of of of of of of of \
of of of of of of of of of"