Prompt API

Web API to prompt the on-device small language model. For more information, see Prompt a built-in language model with the Prompt API.

User prompt

System prompt

Response constraint schema (load an example)

More settings

N-shot prompt instructions (load an example)

Initial latency: ms First token latency: ms Tokens: Rate: token/sec Total time: ms