AI Stream SDK
AI Stream SDK is a plugin that can quickly implement AI API data streams. It supports various model API forwarding, allowing you to quickly build your API forwarding service.
Features
- Data flow transmission
- Provide real-time monitoring of data stream in each stage
- Unified data stream response end marker
- Future support for calculating token thresholds for model responses
Supported models
Gradually increase support for various models.
