I often have online meetings, and I miss things while jotting down notes, or sometimes forget to take notes altogether.. So I wanted to try a service that records conversations and writes meeting notes for a fee.. But since it's an online service, there were security concerns related to IT, so I couldn't use it.
It's just a simple task of recording the conversation and summarizing it with an LLM.. Even if the quality isn't great, I wanted to try solving everything locally on my computer, so I used Copilot CLI and worked hard.
I set the model selection to automatic, and it chose Claude Sonnet 5. It took about 30 minutes of tinkering to create the result, and I had to debug it a couple of times, but eventually, I got an app that worked as I wanted.
What I requested was Python, PySide6 (for the graphical user interface), Faster-whisper (for speech recognition), and Apple Foundation Model (a local model pre-installed on Macs) for the on-device LLM. The final result, the summarized meeting notes, was also formatted in Markdown.
I thought about releasing it as open source at first, but it's too rough and simple to be proud of.. But for personal use, it's not bad (although it's not great either and lacks a lot compared to commercial solutions).
I might consider polishing it up and releasing it on GitHub later.. But for now, it's still in the early stages and the result is too rough.. I need to keep working on it.
As a reference, here's how I implemented it:
I distinguished between my voice from the microphone and the other person's voice from system audio. It recorded who said what with timestamps. So multi-person meetings might be difficult. It works perfectly fine for 1:1 meetings.
When you press "Start Meeting," Faster-whisper starts recording the conversation.. Additionally, users can add notes with timestamps, which are continuously recorded like a chat.
Finally, when you press "End Meeting," the LLM summarizes the conversation and notes into a neatly formatted Markdown meeting note.
I haven't tested it with any languages other than English.
Since I work in the US, all my meetings are in English.. I haven't even tested if it works with Korean.
I might improve it later if needed.
