Will a free LLM chatbot exist which has significant long term memory in 2023?
61
1.2kṀ4543
resolved Apr 14
Resolved
YES

For instance being able to reliably recall specific details such as a name which was only mentioned once in the middle of a chat session hundreds of messages long

Get
Ṁ1,000
to start trading!

🏅 Top traders

#NameTotal profit
1Ṁ261
2Ṁ137
3Ṁ57
4Ṁ53
5Ṁ46
Sort by:

There haven't been any objections so resolves YES due to Replika!

Replika?

@anne Just looked it up and I can't really think of any reason why that wouldn't qualify for a YES resolution. I'll leave the market open for at least a little while longer in case anybody has any objections or comments to make. It seems like Replika not only keeps names, dates, and birthdays in its memories but anything it judges to be important which definitely fufills the spirit of the question

Something like this has basically been created? https://twitter.com/rikvk01/status/1644787327057776645

predictedNO

@jonsimon Now it all depends on whether that dev has made something that only works in a short demo or if it can remember something "in the middle of a chat session hundreds of messages long"

@Shelvacu I'm sure this demo is brittle. But I'm sure this or something like it can be turned into something passably useable within the next 8 months. That's an eternity in AI time.

This might already be possible with GPT-4 with 32k of context (100 tokens per message times a few hundred messages fits), but that's too expensive for a free chatbot. I think you'd need to use a search mechanism; probably this can be made good enough to satisfy this.

@osmarks yeah I agree that the main thing limiting a YES resolution on this market right now is the cost. I’m interested to here more about “search mechanism”. If possible I’ll hold off on a resolution until it’s not controversial

predictedYES

@DylanSlagh Instead of feeding your entire conversation to your language model, which is impractical due to attention scaling quadratically (and none of the subquadratic attention things seemingly being any good), you can store previous messages and when writing the next one give the model the most relevant ones from its history. This has been known about for a while (e.g. https://github.com/AeroScripts/HiddenEngrams), and OpenAI has the related ChatGPT retrieval plugin now, but I haven't gotten round to checking whether the state-of-the-art stuff could be made good enough to satisfy this market.

© Manifold Markets, Inc.Terms + Mana-only TermsPrivacyRules