Jump to content

Ayai · GPT Nexus - ChatGPT, Claude, Gemini, Perplexity, Local LLMs


Recommended Posts

Posted (edited)

Hey everyone!

 

I'm excited to share the alpha preview of Ayai - GPT Nexus with you, a workflow that lets you interact with various AI language models.

The workflow integrates APIs from OpenAI, Anthropic, and Google, while also supporting local LLMs.

 

Why an Alpha Preview?

 

While Ayai - GPT Nexus is still a work in progress, it’s already quite useful. Development has slowed down recently, and I’m not actively working on it as much. Rather than keep it under wraps until it's perfect, I wanted to release it now so you can take advantage of its current features and provide feedback that could shape its future development.

 

Current Features

  • Chat with AI Models: Interact with ChatGPT, Claude, Perplexity, and Gemini.
  • Third-Party Proxies: Connect through OpenRouter, Groq, Fireworks, Together.ai, and other proxies compatible with OpenAI's response format.
  • Local LLMs: Use local models via interfaces like Ollama or LM Studio.
  • Live Web Search: Enable live web search for OpenAI models with additional Exa.ai or Azure API keys (experimental).

 

What’s Missing?

 

The "Ayai" part of the name hints at some personal AI assistant features I have in mind and plan to explore in the future. Additionally, the text processing features like paraphrasing, simplifying, changing the tone of text, or summarizing documents (PDFs, docx, text files, etc.) without needing to go through the chat window are still on the to-do list.

 

Your feedback is, of course, appreciated!

 

Download here: Ayai · GPT Nexus on Github

 

image.thumb.png.520fdad480a32e0e1000a115df349e01.png

 

 

Looking forward to hearing what you think!

 

Edited by zeitlings
Link to comment

I want to call attention to some aspects that are easily overlooked and share some tips.

 

Note the hidden options, i.e. modifiers mentioned in the documentation to make use of 

  • Multi-Line prompt editing
  • Vocalization of the most recent answer (See here how to change the voice)
  • The HUD to quickly check your most important current settings.

Some third party proxies allow you to use certain models for free.

  • For example, Groq currently grants access to Llama 3 70B, which is en par with Gemini 1.5 Pro according to some benchmarks.
  • OpenRouter curates a list of free models that can be used with their API.
  • The new API for Google's Gemini is currently in beta. If your API requests are detected as coming from the US, Gemini comes with a substantial free tier quota for both Gemini 1.5 Flash and Pro.

I also encourage you to explore local LLMs. Meta recently released their Llama 3 model, and the "tiny" Llama 3 8B performs beautifully on newer Macs. According to some benchmarks, the 8B version competes with GPT 3.5 Turbo, and I can confirm that I was at least very positively surprised by its capabilities. Related: Ollama Workflow.

 

 

Link to comment
Posted (edited)
6 hours ago, rudraadavee said:

hey messed with the workflow for a while and found that the "new chat" function has stopped working

 

I've just checked all the possible ways to start a new chat, and they all work on my end. (Without more information, I can't infer where it stopped working for you or why.)

Don't forget to keep an eye on the debugger to potentially identify any problems more easily.

 

6 hours ago, rudraadavee said:

also could you help me with the path in "openai_alternative_local_url_path" in case of local LLMs?

 

Sure, what's the problem? 

Edited by zeitlings
Link to comment

Hi @zeitlings, I'm curious about the integration with Exa.ai. If I add an API key, does every message I send through the workflow get filtered through Exa.ai? Or is only certain messages based on how the prompt is formulated? Thanks!

Link to comment

Only messages that the model deems to require real-time information will elicit a detour through exa.ai. OpenAI dubbed this tool- or function calling.

I caution the model to be extremely conservative about calling the function, so ideally it should only happen when really necessary. Whenever it does happen, you will notice that a "Searching" notification is injected into the conversation! This is when the external API is contacted, otherwise exa sees nothing, and even then it doesn't see your message, but only a search query constructed by the model to get the information it needs.

Link to comment

The Exa.ai integration works great! I'm unfortunately unable to start a new chat, though. The following error appears in the debug log:

 

[16:11:00.309] STDERR: Ayai · GPT Nexus[Run Script] mkdir: /Users/*/Library/Application Support/Alfred/Workflow Data/com.zeitlings.gpt.nexus: No such file or directory
mv: rename /Users/*/Library/Caches/com.runningwithcrayons.Alfred/Workflow Data/com.zeitlings.gpt.nexus/chat.json to /Users/*/Library/Application Support/Alfred/Workflow Data/com.zeitlings.gpt.nexus/archive/20240606-1611-b910df14f9c640c983679ff663ed008e.json: No such file or directory

 

Link to comment
3 hours ago, iandol said:

Wow, amazing set of supported interfaces, thank you @zeitlings -- beautiful icon too!!!

 

Thanks 🤗

 

3 hours ago, iandol said:

On github, alpha.1 is newer than alpha.2, I assume alpha.2 is the better one to download though?

 

Is it? I noticed that the sorting looks wrong when viewing all releases, do you mean this? But alpha.2 should be set as the latest release. So yes, alpha.2 has some fixes and changes over alpha.1. However, mind that the problem with the data directory not being created is not fixed yet.

Link to comment
  • zeitlings changed the title to Ayai · GPT Nexus - ChatGPT, Claude, Gemini, Perplexity, Local LLMs
  • 2 weeks later...

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
×
×
  • Create New...