Working with large documents with AI

[yantakus]

Hi there. Thanks for the awesome editor. I saw you are open to feedback regarding AI integration use cases.

In the app I'm building, users can create large documents (hundreds of pages).

Then they should be able to ask AI if the document adheres to certain rules. If some pieces of text break the rules, AI should provide suggestions on how to fix them.

I'm thinking about how to implement this with BlockNote and a few questions arise:

• How do I deal with docs that are larger than LLM's context window? Somehow process text in chunks?
• If there are multiple suggestions, how do I display them separately so that the user can accept/discard them individually? This is what I see in docs:

 /** Accept the changes made by the LLM */
  acceptChanges(): void;

So it seems there's no way to have multiple changes.

Is there a way to achieve this?

[sanztheo]

I have the same problem when I work on large documents, the AI stops responding.