Add experimental AI Assistant option

[josephjclark]

apollo now (or will have imminently) a new global_chat endpoint to power the global assistant.

Right now the global assistant is really only suitable for generating new workflows with job code (which is pretty cool!).

For many types of user question, the global assistant is likely to be slower, more expensive and less accurate in its responses. While the apollo teams works on tuning other use-cases, we'd still like to integrate the assistant into lightning to start adding value for the things it IS good at.

This issue is to add an option to the app to enable power users (probably just staff) to test the global assistant in the app UI.

Requirements

• Add some kind of opt-in option to the app to grant users access to the global assistant
• Limit global assistant access to the workflow editor page only (for now)

Global Assistant API

The global assistant has a different API to the job_chat and workflow_chat, so some development work is needed to conform to this AI.

See the latest spec at: https://github.com/OpenFn/apollo/blob/supervisor-agent/services/global_agent/PAYLOAD_SPEC.md

Implementation Ideas

We anticipate poor performance of the global assistant in many many use cases. So the aim here is just a minimal integration that we can test against. This is not yet intended for end users.

What I think we want to do is:

• For users with experimental features enabled
• Add a checkbox to the AI Assistant UI
• The checkbox is disabled by default
• When enabled, any requests are sent to the global assistant

.

Check box in workflow chat if experimental feature is enabled