Monitor usage and performance for your application

Resource usage

Model deployment:
05/16/2024 - 05/23/2024

Summary

Total requests
243
Total token count
18,400
Prompt token count
11,700
Completion token count
6,700

Usage metrics

Input vs Output vs Total
40003200240016008000Token Count16 MayTime (Local)23 May
Total token count
Total prompt token count
Total completion token count
Number of requests
50403020100Number of requests16 MayTime (Local)23 May
Number of requests

Latency metrics

Time to first byte (in ms)
1501209060300Time to first byte (in ms)16 MayTime (Local)23 May
Time to first byte (in ms)
Time to last byte (in ms)
5004003002001000Time to last byte (in ms)16 MayTime (Local)23 May
Time to last byte (in ms)