recipes

This repository contains all the recipes that you can use with Chonkie to manage various documents, languages, and more.

Usage

To use the recipes, you need to install chonkie with the hub feature, with the following command:

pip install "chonkie[hub]"

This would enable Hubie which is used internally to get the recipes from this repository. So, you can do things like use the from_recipe method to create a RecursiveChunker from a recipe.

from chonkie import RecursiveChunker

chunker = RecursiveChunker.from_recipe("markdown")

with open("example.md", "r") as f:
    text = f.read()

chunks = chunker.chunk(text)

for chunk in chunks:
    print(chunk)

The above code would read the example.md file and chunk it into smaller chunks using the markdown recipe.

Recipes

The recipes are stored in the recipes folder. Each recipe is a JSON file that contains the rules for the recipe.