This is actually brilliant work by microsoft: https://github.com/microsoft/aici.

Sending mini WASM programs instead of prompts to LLM providers would be incredibly powerful. Multiturn, , Grammar, COT, RAG, function calling, etc could all massively benefit from this

Go to Source