codewithkyrian / jinja-php
A minimalistic PHP implementation of the Jinja templating engine, specifically designed for parsing and rendering ML chat templates.
Installs: 20 037
Dependents: 2
Suggesters: 0
Security: 0
Stars: 10
Watchers: 2
Forks: 1
Open Issues: 2
Requires
- php: ^8.1
Requires (Dev)
- pestphp/pest: ^2.34
- symfony/var-dumper: ^6.3|^7.0
README
A zero-dependency PHP implementation of the Jinja templating engine, specifically designed for parsing and rendering machine learning (ML) chat templates. This project is heavily inspired by HuggingFace's Jinja template engine in JavaScript, intended primarily for ML chat templates, but is versatile enough to be used for general purposes of parsing most Jinja templates.
Installation
Install Jinja PHP through Composer:
composer require codewithkyrian/jinja-php
Quick Start
Here's how you can use Jinja PHP to render a template:
$sourceString = "{{ bos_token }}{% for message in messages %}{% if (message['role'] == 'user') != (loop.index0 % 2 == 0) %}{{ raise_exception('Conversation roles must alternate user/assistant/user/assistant/...') }}{% endif %}{% if message['role'] == 'user' %}{{ '[INST] ' + message['content'] + ' [/INST]' }}{% elif message['role'] == 'assistant' %}{{ message['content'] + eos_token + ' ' }}{% else %}{{ raise_exception('Only user and assistant roles are supported!') }}{% endif %}{% endfor %}"; $args = [ 'messages' => [ ['role' => 'user', 'content' => 'Hello!'], ['role' => 'assistant', 'content' => 'Hi! How are you?'], ['role' => 'user', 'content' => 'I am doing great.'], ['role' => 'assistant', 'content' => 'That is great to hear.'], ], "add_generation_prompt" => true, "bos_token" => "<s>", "eos_token" => "</s>", "unk_token" => "<unk>", ]; $template = new Template($sourceString); $rendered = $template->render($args); // <s>[INST] Hello! [/INST]Hi! How are you?</s> [INST] I am doing great. [/INST]That is great to hear.</s>
Features
✅ Supported Features
Control Structures
- Conditional Statements:
{% if %}
,{% elif %}
,{% else %}
,{% endif %}
- For Loops:
{% for %}
,{% else %}
,{% endfor %}
with loop variables (loop.index
,loop.index0
,loop.first
,loop.last
,loop.length
,loop.previtem
,loop.nextitem
) - Break/Continue:
{% break %}
,{% continue %}
for loop control - Ternary Expressions:
{{ value if condition else other_value }}
Variables & Data
- Variable Output:
{{ variable }}
- Negative Array Indexing:
messages[-1]
,array[-2]
(Python-style) - Object/Array Access:
user.name
,messages[0]['content']
- Null Literals:
none
,None
- Boolean Literals:
true
,false
,True
,False
- String Concatenation:
{{ "Hello" ~ " " ~ "World" }}
Macros & Functions
- Macros:
{% macro name(arg1, arg2) %}...{% endmacro %}
with{{ name() }}
calls - Function Calls:
{{ function(arg1, arg2) }}
- Keyword Arguments:
{{ function(param1=value1, param2=value2) }}
- Spread Arguments:
{{ function(*args) }}
Filters
- String Filters:
lower
,upper
,title
,capitalize
,strip
,lstrip
,rstrip
- String Manipulation:
replace
,split
,startswith
,endswith
,indent
- Array Filters:
length
,join
,map
,reverse
,sort
- Data Filters:
tojson
,default
- Custom Filter Blocks:
{% filter filter_name %}...{% endfilter %}
Advanced Features
- Comments:
{# This is a comment #}
- Set Statements:
{% set variable = value %}
and block sets{% set variable %}{% endset %}
- Call Blocks:
{% call macro_name() %}...{% endcall %}
- Exception Handling:
{{ raise_exception('Error message') }}
- String Concatenation: Multiple string literals and
~
operator
Built-in Functions
range()
: Generate number sequencesraise_exception()
: Throw runtime exceptionslen()
: Get length of arrays/strings
🔄 Partially Supported Features
- Complex Expressions: Most Jinja expressions work, but some edge cases may differ
- Template Inheritance: Basic support (limited)
- Custom Filters: Can be added via the Environment class
- Whitespace Control: Basic support with
{%-
and-%}
❌ Not Yet Supported
- Template Inheritance:
{% extends %}
,{% block %}
,{% include %}
- Custom Functions: User-defined functions
- Advanced Filters: Some complex filters like
groupby
,batch
Usage Examples
Conditional Statements
{% if user.isActive %}
Hello, {{ user.name }}!
{% elif user.isGuest %}
Hello, Guest!
{% else %}
Please log in.
{% endif %}
For Loops with Loop Variables
{% for user in users %} {{ loop.index }} - {{ user.name }} {% if loop.first %}First user{% endif %} {% if loop.last %}Last user{% endif %} {% else %} No users found. {% endfor %}
Macros
{% macro format_user(user) %} <div class="user"> <h3>{{ user.name|title }}</h3> <p>{{ user.email|lower }}</p> </div> {% endmacro %} {{ format_user(current_user) }}
String Manipulation
{{ "Hello World!"|upper|replace("WORLD", "PHP") }} {{ " hello "|strip|capitalize }} {{ "apple,banana,cherry"|split(",")|join(" and ") }} {{ "Hello" ~ " " ~ "World" }}
Array Operations
{% for item in items|sort %} {{ item }} {% endfor %} {{ messages[-1]['content'] }} {# Last message #} {{ array|length }} {# Array length #}
Set Statements
{% set greeting = "Hello, " ~ user.name %} {{ greeting }} {% set user_info %} Name: {{ user.name }} Email: {{ user.email }} {% endset %} {{ user_info|indent(2) }}
Filter Blocks
{% filter upper %} This text will be uppercase {% endfilter %}
Comments
{# This is a comment that won't appear in output #} {{ variable }} {# Inline comment #}
Advanced Usage
Error Handling
{% if user.role == 'admin' %} Admin panel {% else %} {{ raise_exception('Access denied') }} {% endif %}
Complex Expressions
{{ (user.isActive and user.hasPermission) or user.isAdmin }} {{ messages|length > 0 and messages[-1].role == 'user' }} {{ "Hello" if user.name else "Guest" }}
Testing
Jinja PHP comes with a comprehensive test suite to ensure functionality remains consistent and reliable. To run the tests:
composer test
The test suite includes:
- Unit tests for all language features
- End-to-end template processing tests
- Error handling and edge case tests
Performance
Jinja PHP is designed for performance with:
- Zero external dependencies
- Efficient tokenization and parsing
- Optimized runtime execution
- Memory-conscious design
Contributing
Jinja PHP is designed to be robust and feature-rich, offering support for a wide range of functionalities. If there's a feature you need that isn't currently implemented, we encourage you to request it. Additionally, if you're proficient with PHP and understand the internals of templating engines, consider contributing to the project by submitting a pull request with your proposed feature.
Contributors
- Kyrian Obikwelu
- Other contributors are welcome.
Acknowledgements
- Hugging Face for their work on ML chat templates.
- The Jinja template engine for Python, which served as the primary inspiration for this project.
Support
If you find any issues or have a question, feel free to open an issue in the repo.
License
This project is licensed under the MIT License. See the LICENSE file for more information.