AI models used by Reelary
Last updated: September 30, 2026
Reelary does not use a proprietary model of its own. Every AI feature runs on a published model from the developer below, downloaded once and then run locally on your Mac or PC. Your footage, voice samples and generated media are not sent to us or to these developers.
| Feature | Model | Developer | What it does |
|---|---|---|---|
| Visual search (fast tier) | MobileCLIP-S2 | Apple | Turns frames and your search text into vectors for search by meaning. |
| Visual search (quality tier) | SigLIP ViT-B/16 | Higher-accuracy image and text embeddings, picked automatically for faster machines. | |
| Speech transcription and captions | Whisper base (whisper.cpp) | OpenAI | Transcribes dialogue for dialogue search and automatic captions. |
| Scene descriptions | InternVL3-1B | OpenGVLab (Shanghai AI Laboratory) | Writes a one-line description of each indexed frame. |
| Semantic text search | multilingual-e5-small | Microsoft | Matches transcripts and scene descriptions by meaning, across languages. |
| People (face grouping) | YuNet + SFace | OpenCV Zoo | Detects faces and groups clips of the same person. Names are only ever added by you. |
| Voice-over and voice cloning (TTS) | Chatterbox Turbo, Chatterbox Multilingual | Resemble AI | Text-to-speech narration from preset voices, or from a voice sample you provide (Pro). |
| Auto-reframe (9:16 / 1:1) | YOLOX-Tiny | Megvii | Finds the main subject so vertical and square crops keep it in frame. |
| Object and watermark removal | MI-GAN | Picsart AI Research | Fills in the area you mark on a frame. |
Script-to-search terms
When you write a script, Reelary turns it into shot search phrases. By default this runs locally with no language model at all. You can optionally connect any OpenAI-compatible chat API (for example OpenAI GPT models) in Settings. In that case only the script text you type is sent to the provider you configured, using your own API key; no footage is ever sent.
Voice cloning and synthetic media
Voice cloning only uses a sample you import yourself, and you may only clone your own voice or a voice whose owner has consented. Generating sexual, violent, hateful, child-endangering, impersonating or infringing content is prohibited. See the content rules in our Terms of Service for the full list, how we handle violations and how to report misuse.
Contact
Questions about the models, or want to report misuse? Email support@reelary.app.