Implement cache DB support for server configuration in multi-node environments #70
Description
Description
Implement support for using cache databases (Redis, Dragonfly, Valkey) for storing server configuration details across all libraries in ForgeBase. This will make ForgeBase more suitable for multi-node environments by ensuring configuration consistency across nodes.
Requirements
- Add support for Redis, Dragonfly, and Valkey as cache providers
- Create a configuration service that can store and retrieve configuration from the cache
- Update all libraries to use this configuration service instead of in-memory or local storage
- Ensure configuration changes are propagated to all nodes in real-time
- Add documentation for setting up and using the cache configuration
Benefits
- Consistent configuration across all nodes in a multi-node deployment
- Real-time propagation of configuration changes
- Improved scalability for large deployments
- Better support for containerized environments like Kubernetes
Related
- This addresses the issue mentioned in note.md about excludedTables needing to be provided at build time for multi-node environments
Implementation Notes
- Consider using a pub/sub mechanism for real-time updates
- Implement fallback to local storage if cache is unavailable
- Add configuration options for cache connection details
- Ensure proper error handling for cache connection issues