
Security.dev
The middleware between APIs and LLMs
Hello everyone 👋🏼,
Since the announcement of ChatGPT plugins last week I have been thinking about what will be required to convert existing APIs into an LLM Plugin - I guess ChatGPT is only the first LLM that will offer these, all emerging ones and competitors like Bard will follow this plugin approach.
I can imagine it will become a hassle to build the required API specifications (OpenAPI), manage different API versions deployed over multiple LLMs, and implement necessary monitoring and security features.
So I partnered up with 2 friends of mine and we have started building a tool that aims to make the deployment of plugins extremely easy and automatically adds user monitoring and security features on top: https://security.dev
Would love to hear your thoughts and feedback on this.
About
We want to build the universal middleware between APIs and LLMs. We start with making the deployment of LLM plugins extremely easy and automatically adding user monitoring and security features.

Comment