Copycat L3 indexer and GraphQL#903

Draft

speeddragon wants to merge 65 commits into

edgefrom

feat/new-copycat

Commits on Jun 3, 2026

fix: Add try/catch on hb_store_arweave
speeddragon
committed
feat: Add L1 TX filtering with owner and tag support

charmful0x
authored and
speeddragon
committed
feat: Add L1 TX offset loading and configuration

charmful0x
authored and
speeddragon
committed
feat: Add block N depth indexing

charmful0x
authored and
speeddragon
committed
test: Add tests and refactor copycat internals

JamesPiechota
authored and
speeddragon
committed
impr: Add indexer logging and response improvements

JamesPiechota
authored and
speeddragon
committed
fix: Operational fixes for copycat indexer

JamesPiechota
authored and
speeddragon
committed
feat: Add per-block item index with depth tracking

nikooo777
authored and
speeddragon
committed
feat: Add parallel block processing with shared memory budget

nikooo777
authored and
speeddragon
committed
feat: Add parent lookup endpoint at ~arweave@2.9/parent=<id>

nikooo777
authored and
speeddragon
committed
fix: Stop latest_height from silently returning 0 on network errors

nikooo777
authored and
speeddragon
committed
fix: Catch non UTF8 tags error
speeddragon
committed
impr: Missing try catch on non UTF8 tags
speeddragon
committed
impr: signed not needed
speeddragon
committed
impr: Add overlay_count metrics from store LMDB to see if server is writting faster than OS is writting in disk
speeddragon
committed
impr: Check if write fails and throw fast in index write cases
speeddragon
committed
impr: Add a max retry limit to hb_copycat_budget
speeddragon
committed
impr: Remove dead code
speeddragon
committed
impr: Remove memory_safe_cap (redundant), to only use copycat_memory_budget
speeddragon
committed
impr: Do not return not_found where there is an error in dev_arweave:parent
speeddragon
committed
impr: Re-add warning before exit on hb_event
speeddragon
committed
impr: Minor fixes
speeddragon
committed
impr: stop monitor in hb_store_lmdb
speeddragon
committed
impr: Fix hb_store new structure for previous changes
speeddragon
committed
impr: document (subfork) offset index upgrade, allowing `relative` refs

samcamwilliams
authored and
speeddragon
committed
wip: impl improved offset indexing format; tidy Arweave data access routes

samcamwilliams
authored and
speeddragon
committed
wip: progress towards `GET /raw` on pending IDs

samcamwilliams
authored and
speeddragon
committed
slop: Claude's draft of copycat on pending

samcamwilliams
authored and
speeddragon
committed
fix: port restore chunk reads without explicit len fix from impr/

charmful0x
authored and
speeddragon
committed
fix: stale start-offset usage

charmful0x
authored and
speeddragon
committed
fix: non-numeric pending offsets & tx_to_message hard match

charmful0x
authored and
speeddragon
committed
chore: add pinned dev_arweave:pending/3 list

charmful0x
authored and
speeddragon
committed
fix: attempt 1 for get_chunk_range_relative/4 chunk relative decoding

charmful0x
authored and
speeddragon
committed
fix: index mempool bundle children from raw pending bytes

charmful0x
authored and
speeddragon
committed
fix: normalize arweave reads across pending & confirmed bundle offsets

charmful0x
authored and
speeddragon
committed
fix: bundle l2 items discovery

charmful0x
authored and
speeddragon
committed
feat: stable pending-chunks traversal

charmful0x
authored and
speeddragon
committed
feat: mempool copycat rich logs

charmful0x
authored and
speeddragon
committed
feat: filter TXs by sender

charmful0x
authored and
speeddragon
committed
chore: add tests

charmful0x
authored and
speeddragon
committed
feat: add mempool sender filtered determinsitv test

charmful0x
authored and
speeddragon
committed
fix: pending header recursion - rebase

charmful0x
authored and
speeddragon
committed
fix: mempool test

charmful0x
authored and
speeddragon
committed
fix: tests in dev_copycat_arweave after edge rebase
speeddragon
committed
fix: encode anchor based on arweave spec

Lucifer0x17
authored and
speeddragon
committed
fix: no variable can return null or not_found rather than empty map

Lucifer0x17
authored and
speeddragon
committed
chore: clean the code

Lucifer0x17
authored and
speeddragon
committed
fix: breaking tests and some cleanup

Lucifer0x17
authored and
speeddragon
committed
feat(wip): store tx-headers in local-store to access via graphql

Lucifer0x17
authored and
speeddragon
committed
chore: fix a test

Lucifer0x17
authored and
speeddragon
committed
feat: added support for fee in graphql

Lucifer0x17
authored and
speeddragon
committed
fix: avoid rest of the filter also failing if first filter failed

Lucifer0x17
authored and
speeddragon
committed
impr: Moving some functions to hb_store_arweave from dev_copycat_arweave, tests fixed on hb_store_arweave
speeddragon
committed
impr: Fix bug on index scope
speeddragon
committed
impr: Use hb_opts instead of hb_maps
speeddragon
committed
impr: Make test work after rebase
speeddragon
committed
feat: optimize the header indexing size on disk

Lucifer0x17
authored and
speeddragon
committed
fix: gql queries matching with lower and uppercase tag names

Lucifer0x17
authored and
speeddragon
committed
chore: align rebase resolutions with edge conventions

nikooo777
authored and
speeddragon
committed
fix: prevent crash on copycat tag filtering

nikooo777
authored and
speeddragon
committed
fix: bound copycat range test indexing depth

nikooo777
authored and
speeddragon
committed
feat(query): self-contained block-range, tx.block, tag and owner queries

Lucifer0x17
authored and
speeddragon
committed
refactor(copycat): consolidate result-map and json-response helpers

Lucifer0x17
authored and
speeddragon
committed
fix: Test without binary store key
speeddragon
committed
fix(query): declare graphql as hb app dep so it ships in releases
Lucifer0x17
committed