Online API

[jlambe]

This is a wonderful tool to assist in searching your SwordSearcher Library. As far as the AI portion, my computers are too slow to process and with each search the local model crashes during processing. I currently have a 16gb of ram computer but have 8gb of ram available. Can anyone suggest a work around, or free version of OpenAI API key to enter into the Librarian?

 

[Brandon Staggs]

This is a wonderful tool to assist in searching your SwordSearcher Library. As far as the AI portion, my computers are too slow to process and with each search the local model crashes during processing. I currently have a 16gb of ram computer but have 8gb of ram available. Can anyone suggest a work around, or free version of OpenAI API key to enter into the Librarian?

There's no free online API for something like this. If your hardware cannot run LLMs your only option is to get an account with Anthropic or OpenAI and use an API key. That's pay-as-you-go but you can get started for as little as $5.

 

[RevTim]

There's no free online API for something like this. If your hardware cannot run LLMs your only option is to get an account with Anthropic or OpenAI and use an API key. That's pay-as-you-go but you can get started for as little as $5.

What does the $5 investment get you?

 

[Brandon Staggs]

What does the $5 investment get you?

API key credits.

 

[RevTim]

Ok, bad question. How much activity? In terms of queries or amount in terms of answers?

 

[Brandon Staggs]

Ok, bad question. How much activity? In terms of queries or amount in terms of answers?

I can't answer that definitively. It depends on which model you configure and the queries. For $5 you could try a few queries and monitor your api credits to see how quickly they are consumed processing the queries and make a judgment as to value. These are extremely rough estimates:

• Sonnet 4.6: very roughly 15–25 cents per question.
• Opus 4.8: very roughly 25–40 cents per question.

Sonnet is more than adequate.