Disclaimer: This article uses the software NeoBoard from my current employer. All opinions are my own. My employer is not responsible for any of my doings described in this article.
Don’t miss the innovation tldraw computer brings to online whiteboards!
Just before 2024 ended, the developers of the open source whiteboard SDK tldraw published an innovative idea of how to build interactive whiteboards. Intended as a demo of their SDK, they implemented diagrams where values can be pushed from note to note and also parsed for conditions. Likely because of how this closely resembles how a computer works, they named it tldraw computer.
Their integration with LLMs is the icing on the cake. Notes can contain texts, images, audio or websites which can all be generated based on other notes. It’s also super cool that they published a YouTube video explaining how tldraw computer works, including their pre-prompts and hidden raw values of notes.
Integrating AI into NeoBoard
It blew me away how cool this tool is and after sleeping over it for a night, I got started building a prototype based on NeoBoard. This is not a planned feature, but just a demo I’ve built.
I’m using ollama to run LLM models locally. In the code of NeoBoard, I added a robot icon to every note. Clicking the robot will combine all connected notes into a prompt and send it to the AI. Once the AI is done, I write its response into the note.
Note that only notes with incoming arrows are sent to the AI.
Here it is as a video on YouTube: