• 1 Post
  • 4 Comments
Joined 1 year ago
cake
Cake day: June 17th, 2023

help-circle
  • I don’t know how tech savvy you are, but I’m assuming since your on lemmy it’s pretty good :)

    The way we’ve solved this sort of problem in the office is by using the LLM’s JSON response, and a prompt that essentially keeps a set of JSON objects alongside the actual chat response.

    In the DND example, this would be a set character sheets that get returned every response but only changed when the narrative changes them. More expensive, and needing a larger context window, but reasonably effective.