This repository contains an example application for routing requests to a Portkey Gateway deployment. The example is a simple Node.js site that includes a prompt and a model selection box, allowing users to choose which LLM model they wish to query. You can find out more by visiting the associated tutorial.
Before you deploy the example application, you'll need to do the following:
- Deploy the Portkey Gateway Docker image to Koyeb using the instructions from this section of the tutorial.
- Sign up for Groq and copy your API key.
- Sign up for Together AI and copy your API key.
The fastest way to deploy the Portkey Gateway example application to Koyeb is to click the Deploy to Koyeb button below.
On the configuration page, expand the Environment variables section and enter the values for your API keys and Portkey Gateway deployment URL (without a trailing slash).
Once the example application is deployed, you can access the web interface by visiting the deployment's public URL.