Structured Text Generation

The AI framework that adds the engineering to prompt engineering (Python/TS/Ruby/Java/C#/Rust/Go compatible)

Resource list for generating JSON using LLMs via function calling, tools, CFG. Libraries, Models, Notebooks, etc.

Fast, Flexible and Portable Structured Generation

Faster structured generation

Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models

Query language for blending SQL logic and LLM reasoning across structured + unstructured data. [Findings of ACL 2024]

Extract structured data from local or remote LLM models

TensorRT-LLM server with Structured Outputs (JSON) built with Rust

NLP tasks with zero- and few-shot models.

The developper starter pack for document processing

Structured Generation Evals

A guide to structured generation using constrained decoding

Use `outlines` generators with Haystack.

Speculative grammar backtracking algorithm for LLM decoding conforming to some lark context-free grammar (CFG)

Presentación en la conferencia IADevs 2024: Potenciando la Generación Aumentada usando Recuperación con Grafos de Conocimiento

Word alignment of multilingual sentences using structured generation

Presentation at PyData Global: Building Knowledge Graph-Based Agents with Structured Text Generation and Open-Weights Models

A comprehensive toolkit for streamlining and simplifying the offline inference process for LLMs across various models and libraries.

Mistral AI Fine-tuning Hackathon