Skip to content

Non-functional OpenZL prototype#799

Open
lemire wants to merge 2 commits intomasterfrom
openzl
Open

Non-functional OpenZL prototype#799
lemire wants to merge 2 commits intomasterfrom
openzl

Conversation

@lemire
Copy link
Copy Markdown
Member

@lemire lemire commented Apr 3, 2026

Long term, we want to support OpenZL.

This is a prototype written with Claude, but Claude says that little of the SDDL format is actually implemented, so we cannot express (yet) our data format.

@Cyan4973

@Cyan4973
Copy link
Copy Markdown

Cyan4973 commented Apr 4, 2026

FYI, SDDL will receive some important upgrades for next OpenZL release, notably an ability to interpret formats with optional fields and sections, alongside substantial speed optimizations. Unfortunately, the sddl spec in this PR also requires the more advanced scan types, for fields which size can only be determined at run time and one by one. Notably:

Record RunContainer() = {
    num_runs:   UInt16LE,       # number of runs in this container
    runs:       Run[num_runs]
}

This capability is well within sddl scope though, and planned for later this year.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants