Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I’ve found the complete opposite as recently as last week. When I ask a deep question about a book it will hallucinate whole paragraphs of bogus justification and even invent characters




The LLM just working on its own is just generative intelligence. You have to ground it if you want the real stuff. The Kindle app has the text of the book and I'd want it to put that in the LLM context.

The entire book in the context at once?

That's probably 100k-150k tokens for most novels.

That’s more reasonable than I thought.

Did you give it the text of the book and tell it to answer based on that?

Does this feature put the entire text of the book into the context?

I hope not, it probably only goes up to the page you are on in order to avoid spoiling the later content.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: