SuperwhisperSuperwhisper
Aug 25

LLM integration

Integrate with an LLM for post processing of transcribed text. Allowing you to prompt with things like: "Rewrite the following into an email format, using a casual informal tone, sign off with "Best, Name" Instead of getting back a literal transcript of what you said the LLM will automatically reformat your message into whatever kind of format you like and it will magically appear in any text box on your mac.
CompletedCompleted
Nov 26, 2023

The feature works beautifully in English! Thanks, Neil Chudleigh! But for other languages, it would be a helpful addition to make the system prompt editable for the LLM, as it currently responds in English instead of sticking to the input language.

Nov 13, 2023

I would like to be able to use my own LLM API key(s) for this feature.

Nov 13, 2023

Justin Brandon: Focused on a locally running LLM first, but will certainly be a feature, which service's API keys would you like to use?

Nov 14, 2023

Neil Chudleigh: Would this update also include a download option for a locally running LLM? Or would that be something that the user would have to do manually?

Nov 14, 2023

Robert Giacinto: Download option for local- starting with mistral 7b but likely going to build out something more robust for managing local models

Nov 14, 2023

Neil Chudleigh: As of now it would only be OpenAI. Thank you.

Oct 31, 2023

Starting work on this really soon.