Academia definitely needs a tool that can parse complex equations, cross-links etc.
I was using notebookLLM today with FAA aviation charts loaded and the tool still hallucinates and does not parse visual data (maps, charts) well. I can imagine that in the world of ArXiv papers similar level of complex charts and visualizations would not be processed properly
Super curious about your thoughts.
it’s also possible that the LLM will be able to determine well which results are important vs which are minor improvements / changes that are not important for me to listen to.
the economist does a „world in brief” news summary daily, and having that for the papers that are relevant to me would be great!
I like the idea of the "world in brief" - I will try to add it.
I made my own little service that converts any webpage to hopefully the parsed content then uses Google TTS and then published it to a bucket and s3 feed and I listen to them on my phone before bed.
Do you see anything that we could add to the tool to make it more useful for you?
One thing we played around with, which works quite well is directly interfacing it with GPT-realtime. This then allows one to talk to it about the paper. It also solves the problem of the language since any person can talk to it in their own language, which could increase accessibility in science. I have shown it to some Japanese colleagues the other day and they could interact with it in Japanese which was quite amazing.
https://scirate.com/
But seriously, I don't of another place that centers academics up-voting papers without... well... actually citing them.Do you have any thoughts on @joshny's comment? It is something we don't know exactly what would be the best strategy to deal with it.