Streaming and longer context lengths for LLMs on Workers AI

Workers AI now supports streaming text responses for the LLM models in our catalog, including Llama-2, using server-sent events

catalog context events llama llm llms server streaming text workers workers ai