Skip to content

Navigation Menu

Appearance settings

View all features
- BY COMPANY SIZE
  Enterprises
  Small and medium teams
  Startups
  Nonprofits
- BY USE CASE
  App Modernization
  DevSecOps
  DevOps
  CI/CD
  View all use cases
- BY INDUSTRY
  Healthcare
  Financial services
  Manufacturing
  Government
  View all industries
View all solutions
- EXPLORE BY TOPIC
  AI
  Software Development
  DevOps
  Security
  View all topics
- EXPLORE BY TYPE
  Customer stories
  Events & webinars
  Ebooks & reports
  Business insights
  GitHub Skills
- SUPPORT & SERVICES
  Documentation
  Customer support
  Community forum
  Trust center
  Partners
View all resources
- COMMUNITY
  GitHub SponsorsFund open source developers
- PROGRAMS
  Security Lab
  Maintainer Community
  Accelerator
  GitHub Stars
  Archive Program
- REPOSITORIES
  Topics
  Trending
  Collections
- ENTERPRISE SOLUTIONS
  Enterprise platformAI-powered developer platform
- AVAILABLE ADD-ONS
  GitHub Advanced SecurityEnterprise-grade security features
  Copilot for BusinessEnterprise-grade AI features
  Premium SupportEnterprise-grade 24/7 support
Pricing

Search code, repositories, users, issues, pull requests...

Search

Clear

Search syntax tips

Provide feedback

We read every piece of feedback, and take your input very seriously.

Include my email address so I can be contacted

Saved searches

Use saved searches to filter your results more quickly

Name

Query

To see all available qualifiers, see our documentation.

Appearance settings

You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session.

Dismiss alert

Shopify / liquid Public

Notifications You must be signed in to change notification settings
Fork 1.5k
Star 11.8k

Code
Issues 325
Pull requests 92
Discussions
Actions
Projects
Models
Wiki
Security and quality
Insights

Additional navigation options

Code
Issues
Pull requests
Discussions
Actions
Projects
Models
Wiki
Security and quality
Insights

Performance: 53% faster parse+render, 61% fewer allocations#2056

Open

tobi wants to merge 93 commits into

mainShopify/liquid:mainfrom

autoresearch/liquid-perf-2026-03-11Shopify/liquid:autoresearch/liquid-perf-2026-03-11Copy head branch name to clipboard

Conversation Commits93 (93)Checks Files changed

Open

Performance: 53% faster parse+render, 61% fewer allocations#2056
tobi wants to merge 93 commits into
mainfrom
autoresearch/liquid-perf-2026-03-11

Commits

Commits on Mar 11, 2026

add quick benchmark script for autoresearch
tobi
committed
replace FullToken regex with manual byte parsing in parse_for_document
tobi
committed
replace VariableParser regex scan with manual byte parser in VariableLookup
tobi
committed
add auto/bench.sh: unit tests + liquid-spec + perf benchmark
tobi
committed
use getbyte instead of string indexing in whitespace_handler and create_variable
tobi
committed
use equal? for frozen array comparison in Lexer, skip whitespace with \s+
tobi
committed
avoid unnecessary strip allocation in Expression.parse, use byteslice for string literals
tobi
committed
short-circuit parse_number with first-byte check before regex
tobi
committed
fast-path String in render_obj_to_output, avoid Utils.to_s dispatch for common case
tobi
committed
fast-path variable_lookups: skip mutable string alloc when no dot/bracket follows
tobi
committed
use frozen EMPTY_ARRAY for Variable filters when no filters present
tobi
committed
fast-path simple variable parsing: skip Lexer/Parser for plain dot-separated lookups
tobi
committed
replace SIMPLE_VARIABLE regex with byte-level scanner to avoid MatchData
tobi
committed
fast-path simple if conditions: skip ExpressionsAndOperators scan for single conditions
tobi
committed
skip TagAttributes scan in for tag when no colon present
tobi
committed
fast-path render for filter-less variables: skip render method overhead
tobi
committed
unified fast-path Variable parsing: handle both plain lookups and filter chains without full Lexer pass for name
tobi
committed
expose expression_cache/string_scanner via attr_reader, skip regex in filter args without colon
tobi
committed
replace For tag Syntax regex with manual byte-level parser
tobi
committed
avoid empty array allocation in evaluate_filter_expressions for no-arg filters
tobi
committed
use getbyte dispatch instead of start_with? in parse_for_document
tobi
committed
return [tag_name, markup, newlines] from parse_tag_token: avoid 2 whitespace string allocs
tobi
committed
use frozen EMPTY_ARRAY for disabled_tags in Variable
tobi
committed
hoist write score check out of render loop: skip increment_write_score when no limits active
tobi
committed
skip filter arg splat for no-arg filters, trim render loop comments
tobi
committed
extend fast-path to handle quoted string literal variables (262 more fast-pathed)
tobi
committed
autoresearch: add autoresearch.md/sh, increase benchmark warmup to 20 iterations
tobi
committed
split filter parsing: scan no-arg filters directly, only invoke Lexer when args present
tobi
committed
add security constraint to autoresearch.md, fix strict mode gate
tobi
committed
autoresearch.md: add strategic direction toward single-pass scanner architecture
tobi
committed
clean up filter parsing: Lexer fallback for args, no-arg fast scan stays
tobi
committed
avoid array allocation in parse_tag_token: return tag_name, store markup/newlines as class ivars
tobi
committed
replace WhitespaceOrNothing regex with byte-level blank_string? check
tobi
committed
update autoresearch.md progress log
tobi
committed
fast-path simple if truthiness: use byte scanner before SIMPLE_CONDITION regex
tobi
committed
add invoke_single fast path for no-arg filter invocation, avoids splat alloc
tobi
committed
fast-path find_variable: check top scope first before find_index
tobi
committed
add invoke_two fast path for single-arg filter invocation, avoids splat chain
tobi
committed
fast-path slice_collection: skip copy for full Array without offset/limit
tobi
committed
replace SIMPLE_CONDITION regex with manual byte parser in if/elsif lax_parse
tobi
committed
replace INTEGER_REGEX/FLOAT_REGEX with byte-level parse_number
tobi
committed
use frozen EMPTY_ARRAY/EMPTY_HASH for Context @filters/@disabled_tags
tobi
committed
optimize Context init: avoid unnecessary array wrapping for environments
tobi
committed
update autoresearch.sh: 3-run best-of, skip liquid-spec for speed
tobi
committed
avoid allocating seen={} hash in Utils.to_s/inspect when not needed
tobi
committed
fast-path VariableLookup init: skip scan_variable for simple identifier chains
tobi
committed
add parse_simple to skip simple_lookup? check when caller validates
tobi
committed
introduce Cursor class: centralize byte-level scanning for tag/variable/condition parsing
tobi
committed
remove dead BlockBody.parse_tag_token and If SIMPLE_CONDITION - now in Cursor
tobi
committed
REVERTED: Cursor for For tag adds 148 allocs from scan_id/scan_fragment string creation\n\nResult: {"status":"discard","combined_µs":5049,"parse_us":3765,"render_us":1284,"allocations":29793,"parse…
tobi
committed
Cursor: add skip_id, expect_id, skip_fragment for zero-alloc scanning
tobi
committed
For tag: migrate lax_parse to Cursor with zero-alloc skip_id/expect_id
tobi
committed
update autoresearch.md with full progress log
tobi
committed
fix rubocop offenses: autocorrect style/layout violations
tobi
committed
Fast-path single-arg filter parsing: handle quoted strings, numbers, identifiers without Lexer/Parser\n\nResult: {"status":"keep","combined_µs":4427,"parse_µs":3181,"render_µs":1246,"allocations":2…
tobi
committed
Avoid expr_markup byteslice when name is entire markup string (no whitespace, no filters)\n\nResult: {"status":"keep","combined_µs":4277,"parse_µs":3057,"render_µs":1220,"allocations":27026}
tobi
committed
Extend fast-path filter parsing to handle comma-separated multi-arg filters (e.g. pluralize: 'item', 'items')\n\nResult: {"status":"keep","combined_µs":4266,"parse_µs":3032,"render_µs":1234,"alloca…
tobi
committed
Replace split+join in truncatewords with manual word scan — avoids array + string allocations\n\nResult: {"status":"keep","combined_µs":4280,"parse_µs":3009,"render_µs":1271,"allocations":26395}
tobi
committed
Cache small integer to_s (0-999): avoids 267 Integer#to_s allocations per render cycle\n\nResult: {"status":"keep","combined_µs":4158,"parse_µs":2920,"render_µs":1238,"allocations":26128}
tobi
committed
Lazy Context init: defer StringScanner and @interrupts array allocation until needed\n\nResult: {"status":"keep","combined_µs":4299,"parse_µs":3057,"render_µs":1242,"allocations":26015}
tobi
committed
Cache block_delimiter strings per tag name — avoids repeated string interpolation\n\nResult: {"status":"keep","combined_µs":4372,"parse_µs":3127,"render_µs":1245,"allocations":25605}
tobi
committed
Lazy @changes hash in Registers — only allocate when a register is actually written\n\nResult: {"status":"keep","combined_µs":4287,"parse_µs":3059,"render_µs":1228,"allocations":25595}
tobi
committed
Use EMPTY_ARRAY for empty static_environments in Context — avoids 60 array allocs per render cycle\n\nResult: {"status":"keep","combined_µs":4262,"parse_µs":3079,"render_µs":1183,"allocations":25535}
tobi
committed
Skip respond_to?(:context=) for primitive types in find_variable — avoids method lookup overhead\n\nResult: {"status":"keep","combined_µs":4207,"parse_µs":2943,"render_µs":1264,"allocations":25535}
tobi
committed
Skip find_index when only one scope in find_variable — go straight to environments\n\nResult: {"status":"keep","combined_µs":4323,"parse_µs":3055,"render_µs":1268,"allocations":25535}
tobi
committed
Fast return for primitive types in find_variable — skip to_liquid and respond_to?(:context=)\n\nResult: {"status":"keep","combined_µs":4225,"parse_µs":3009,"render_µs":1216,"allocations":25535}
tobi
committed
Skip to_liquid/context= for primitives in VariableLookup#evaluate\n\nResult: {"status":"keep","combined_µs":4334,"parse_µs":3062,"render_µs":1272,"allocations":25535}
tobi
committed
Fast-path Hash lookups in VariableLookup#evaluate — skip respond_to? checks for Hash objects\n\nResult: {"status":"keep","combined_µs":4110,"parse_µs":2922,"render_µs":1188,"allocations":25535}
tobi
committed
Replace manual byte-level scan_id/skip_id with regex — C-level StringScanner.scan is faster than Ruby-level byte scanning\n\nResult: {"status":"keep","combined_µs":4185,"parse_µs":2943,"render_µs":…
tobi
committed
Replace manual byte-level scan_number with regex — cleaner code, same performance\n\nResult: {"status":"keep","combined_µs":4184,"parse_µs":2931,"render_µs":1253,"allocations":25535}
tobi
committed
Replace manual scan_fragment/scan_quoted_string_raw/skip_fragment with regex — cleaner, same/better perf\n\nResult: {"status":"keep","combined_µs":4132,"parse_µs":2890,"render_µs":1242,"allocations…
tobi
committed
Replace manual scan_comparison_op with regex — cleaner and avoids byteslice allocation for op strings\n\nResult: {"status":"keep","combined_µs":4007,"parse_µs":2808,"render_µs":1199,"allocations":2…
tobi
committed
Replace manual rest_blank? with regex skip + eos? check\n\nResult: {"status":"keep","combined_µs":4047,"parse_µs":2795,"render_µs":1252,"allocations":25535}
tobi
committed
Replace manual scan_quoted_string with regex capture groups\n\nResult: {"status":"keep","combined_µs":4102,"parse_µs":2849,"render_µs":1253,"allocations":25535}
tobi
committed
Replace manual scan_dotted_id with regex\n\nResult: {"status":"keep","combined_µs":4121,"parse_µs":2812,"render_µs":1309,"allocations":25535}
tobi
committed
Minor cleanup: optimize expect_id with while loop and early return\n\nResult: {"status":"keep","combined_µs":4184,"parse_µs":2921,"render_µs":1263,"allocations":25535}
tobi
committed
Skip to_liquid_value for String/Integer keys in VariableLookup — avoids respond_to? dispatch\n\nResult: {"status":"keep","combined_µs":4131,"parse_µs":2893,"render_µs":1238,"allocations":25535}
tobi
committed
Replace manual blank_string? with regex match — cleaner code\n\nResult: {"status":"keep","combined_µs":4196,"parse_µs":3042,"render_µs":1154,"allocations":25535}
tobi
committed
Cache no-arg filter tuples [name, EMPTY_ARRAY] — reuse frozen tuples across templates\n\nResult: {"status":"keep","combined_µs":4147,"parse_µs":2992,"render_µs":1155,"allocations":24881}
tobi
committed
update autoresearch.md with current progress
tobi
committed
Skip context.evaluate for String lookup keys in VariableLookup — avoids respond_to? dispatch\n\nResult: {"status":"keep","combined_µs":4103,"parse_µs":2881,"render_µs":1222,"allocations":24881}
tobi
committed

Commits on Mar 12, 2026

Baseline: 3,818µs combined, 24,881 allocs\n\nResult: {"status":"keep","combined_µs":3818,"parse_µs":2722,"render_µs":1096,"allocations":24881}
tobi
committed
Replace StringScanner tokenizer with String#byteindex — 12% faster parse, no regex overhead for delimiter finding\n\nResult: {"status":"keep","combined_µs":3556,"parse_µs":2388,"render_µs":1168,"al…
tobi
committed
Confirmation run: byteindex tokenizer consistently 3,400-3,600µs\n\nResult: {"status":"keep","combined_µs":3464,"parse_µs":2335,"render_µs":1129,"allocations":24882}
tobi
committed
Clean up tokenizer: remove unused StringScanner setup and regex constants\n\nResult: {"status":"keep","combined_µs":3490,"parse_µs":2331,"render_µs":1159,"allocations":24882}
tobi
committed
parse_tag_token without StringScanner: pure byte ops avoid reset(token) overhead, -12% combined\n\nResult: {"status":"keep","combined_µs":3350,"parse_µs":2212,"render_µs":1138,"allocations":24882}
tobi
committed
update autoresearch docs with current progress
tobi
committed
Clean confirmation run: 3,314µs (-55% from main), stable\n\nResult: {"status":"keep","combined_µs":3314,"parse_µs":2203,"render_µs":1111,"allocations":24882}
tobi
committed
Condition#evaluate: skip loop block for simple conditions (no child_relation) — saves 235 allocs\n\nResult: {"status":"keep","combined_µs":3445,"parse_µs":2284,"render_µs":1161,"allocations":24647}
tobi
committed
Replace simple_lookup? byte scan with match? regex — 8x faster per call, cleaner code\n\nResult: {"status":"keep","combined_µs":3489,"parse_µs":2353,"render_µs":1136,"allocations":24647}
tobi
committed
Inline to_liquid_value in If render — avoids one method dispatch per condition evaluation\n\nResult: {"status":"keep","combined_µs":3459,"parse_µs":2318,"render_µs":1141,"allocations":24647}
tobi
committed
Replace @blocks.each with while loop in If render — avoids block proc allocation per render\n\nResult: {"status":"keep","combined_µs":3496,"parse_µs":2356,"render_µs":1140,"allocations":24530}
tobi
committed
update autoresearch experiment log
tobi
committed

Footer

© 2026 GitHub, Inc.

Footer navigation

Terms
Privacy
Security
Status
Community
Docs
Contact

You can’t perform that action at this time.