Ultra-fast caching for identical requests with streaming support
prompt_cache
object in requests:
enabled
: Required boolean to enable caching for this requestttl
: Optional cache duration in seconds (default: 3600, i.e., 1 hour)temperature: 0
for consistent results