It becomes very laggy after chatting for a long time

Yes, this is very stressful

when is it fixed? It’s frustrating now.

Been two month since the issue raised

I guess i have to stop my subscription to devv this month due to frustation of laggy issue of using this app.

Hello Everyone,

I sincerely apologize for not addressing your feedback in a timely manner. Our team is still quite small, and we haven't yet implemented technologies like virtual scrolling to optimize page performance.

The situation is as follows: Currently, in LLM dialogue/search scenarios, there's an issue that can't be perfectly resolved, which is the model's memory problem. Due to the limited size of the LLM input window, it's unavoidable that if a conversation goes on for dozens or even hundreds of rounds, the model's contextual memory will be lost, leading to memory confusion.

Therefore, based on my personal experience, when finishing a discussion on a particular topic, starting a new thread for further questions tends to yield better and more accurate responses.

Given this experience, rather than optimizing the Long Thread page, we've been focusing more on how to guide users to start new threads for better answers. This is why we haven't done much performance optimization work on this page. I apologize for any inconvenience this may have caused.

非常抱歉一直没有及时的处理好你们反馈的问题，因为团队确实现在还很小，没有及时采用虚拟滚动之类的技术来优化页面性能。

是这样的，目前 LLM 对话/搜索的场景下其实有一个没办法完美解决的问题就是模型的记忆力问题。因为 LLM 输入的窗口大小是有限的，所以没办法避免的是一轮对话如果进行了几十甚至上百轮，那么模型上下文 Context 会丢失，存在记忆错乱的情况。

因此，从我个人的使用经验来说，如果在关于某个话题问题结束的时候，新开启一个 Thread 来进行提问，会让回答的效果和准确度更好。

基于上面的经验，相比于进行 Long Thread 页面的优化，我们更多的在思考如何引导用户开启新的 Thread 来获得更好的回答效果，因此一直没有在这个页面上进行很多的性能优化工作，很抱歉给大家带来了困扰。

Bohan

Devv.AI