On Thursday, DuckDuckGo unveiled a brand new “AI Chat” service that permits customers to converse with 4 mid-range massive language fashions (LLMs) from OpenAI, Anthropic, Meta, and Mistral in an interface much like ChatGPT whereas making an attempt to protect privateness and anonymity. Whereas the AI fashions concerned can output inaccurate data readily, the positioning permits customers to check totally different mid-range LLMs with out having to put in something or join an account.
DuckDuckGo’s AI Chat presently options entry to OpenAI’s GPT-3.5 Turbo, Anthropic’s Claude 3 Haiku, and two open-source fashions, Meta’s Llama 3 and Mistral’s Mixtral 8x7B. The service is presently free to make use of inside day by day limits. Customers can entry AI Chat by means of the DuckDuckGo search engine, direct hyperlinks to the positioning, or through the use of “!ai” or “!chat” shortcuts within the search discipline. AI Chat can be disabled within the web site’s settings for customers with accounts.
In response to DuckDuckGo, chats on the service are anonymized, with metadata and IP handle eliminated to stop tracing again to people. The corporate states that chats are usually not used for AI mannequin coaching, citing its privateness coverage and phrases of use.
“We now have agreements in place with all mannequin suppliers to make sure that any saved chats are utterly deleted by the suppliers inside 30 days,” says DuckDuckGo, “and that not one of the chats made on our platform can be utilized to prepare or enhance the fashions.”
However the privateness expertise just isn’t bulletproof as a result of, within the case of GPT-3.5 and Claude Haiku, DuckDuckGo is required to ship a consumer’s inputs to distant servers for processing over the Web. Given sure inputs (i.e., “Hey GPT, my identify is Bob and I dwell on Major Avenue, and I simply murdered Invoice”), a consumer may nonetheless probably be recognized if such an excessive want arose.
Whereas the service seems to work effectively for us, there is a query about its utility. For instance, whereas GPT-3.5 initially wowed folks when it launched with ChatGPT in 2022, it additionally confabulated lots—and it nonetheless does. GPT-4 was the primary main LLM to get confabulations underneath management to some extent the place the bot turned extra moderately helpful for some duties (although this itself is a controversial level), however that extra succesful mannequin is not current in DuckDuckGo’s AI Chat. Additionally lacking are comparable GPT-4-level fashions like Claude Opus or Google’s Gemini Extremely, seemingly as a result of they’re far dearer to run. DuckDuckGo says it might roll out paid plans sooner or later, and people might embody greater day by day utilization limits or entry to “extra superior fashions.”)
It is true that the opposite three fashions typically (and subjectively) cross GPT-3.5 in functionality for coding with decrease hallucinations, however they will nonetheless make issues up, too. With DuckDuckGo AI Chat because it stands, the corporate is left with a chatbot novelty with a good interface and the promise that your conversations with it’ll stay non-public. However what use are totally non-public AI conversations if they’re filled with errors?
As DuckDuckGo itself states in its privateness coverage, “By its very nature, AI Chat generates textual content with restricted data. As such, Outputs that seem full or correct due to their element or specificity might not be. For instance, AI Chat can not dynamically retrieve data and so Outputs could also be outdated. You shouldn’t depend on any Output with out verifying its contents utilizing different sources, particularly for skilled recommendation (like medical, monetary, or authorized recommendation).”
So have enjoyable speaking to bots, however tread fastidiously. They’re going to simply “lie” to your face as a result of they do not perceive what they’re saying and are tuned to output statistically believable data, not factual references.