Features

LLM integration

3y agoCompleted

Integrate with an LLM for post processing of transcribed text.

Allowing you to prompt with things like:

"Rewrite the following into an email format, using a casual informal tone, sign off with "Best, Name"

Instead of getting back a literal transcript of what you said the LLM will automatically reformat your message into whatever kind of format you like and it will magically appear in any text box on your mac.

and 18 others

7 comments

  1. The feature works beautifully in English! Thanks, Neil Chudleigh!

    But for other languages, it would be a helpful addition to make the system prompt editable for the LLM, as it currently responds in English instead of sticking to the input language.

  2. I would like to be able to use my own LLM API key(s) for this feature.

    1. Justin Brandon: Focused on a locally running LLM first, but will certainly be a feature, which service's API keys would you like to use?

    2. Neil Chudleigh: Would this update also include a download option for a locally running LLM? Or would that be something that the user would have to do manually?

    3. Robert Giacinto: Download option for local- starting with mistral 7b but likely going to build out something more robust for managing local models

    4. Neil Chudleigh: As of now it would only be OpenAI. Thank you.

  3. Starting work on this really soon.