August CopilotKit releases: debugging, async ops for RAG, Groq adapter

Last month’s releases helped developers ship copilots with better experiences all around. From the new CopilotKit runtime to the new generative UI to critical guardrail features in Copilot Cloud.

This month the team shipped new tools like native debugging in the console plus runtime improvements including new features contributed by the community. And don’t miss the latest tutorials and improved UX in the refreshed documentation.

Local debugging tools in the CopilotKit dev console

Helping developers to move fast to test and ship copilot apps Is our objective. The new debugging tools in the dev console enable quick troubleshooting across three critical areas in your app - Readables, Actions, and Check Updates.

• Log Readables - see which real-time state your app is making available to the Copilot
• Log Actions - log the current actions your app is registering with the Copilot
• Check Updates - find out if there are major library updates you should be aware of.

The dev console is enabled by default when running on localhost- and can also be shown or hidden manually. It is displayed at the top-right corner of the Chat UI.

Runtime enhancements with Groq adapter and constructor parameters middleware

Continuing to build on runtime improvements from last month, our adapter library now includes Groq support in addition to Google GenAI, LangChain, and OpenAI.  These service adapters make it easy to leverage the power of AI and LLM platforms in your copilot app with a standardized request and response format.

The runtime also got a significant update with middleware to enable developers to further customize their copilot app in novel ways. Our design philosophy for CopilotKit is ‘batteries included, and replaceable’. We aim to make CopilotKit buttery-smooth for common Copilot use cases; and also to make it adaptable to edge cases we haven’t specifically designed for.

The new middleware lets you pass your code to the Copilot Runtime - to be run in between critical framework-owned steps.

This deployment led to the next exciting feature below, made available by a contribution from the community!

New async operations available for RAG integration

While the CopilotKit messaging handling allowed for synchronized operations, this limited the ability in certain use cases such as when you need to log into databases for retrieval-augmented generation.

Thanks to Steve V S’  contributions, CopilotKit middleware now supports async functions, as well as optimized appending logic, and improved error handling. This is available in the self-hosted version of CopilotKit.

CopilotKit community contributions - thank you!

Speaking of contributors, the contribution guide is updated to make it easier for the community to submit issues, features, and documentation. It’s this community that helps make CopilotKit better for everyone.

Every Thursday join the CopilotKit team in our Discord office hours to catch up on the latest releases, and contributions, and for extra support on the Copilot apps you’re building.‍‍