A SQLite extension for reading large files line-by-line (NDJSON, logs, txt, etc.) License
SQLite Internals: Pages & B-trees
Fly.io runs apps close to users around the world, by taking containers and upgrading them to full-fledged virtual machines running on our own hardware around the world. Sometimes those containers run SQLite and we make that easy too. Give us a whirl and get up and running quickly.Ok, I’ll admit i…
GitHub – superfly/litefs: Distributed SQLite replication system
LiteFS LiteFS is a FUSE-based file system for replicating SQLite databases across a cluster of machines. It works as a passthrough file system that intercepts writes to SQLite databases in order to detect transaction boundaries and record changes on a per-transaction level in LTX files. This proj…
Extending SQLite with Rust to support Excel files as virtual tables
This article explains how SQLite can be extended with Rust. In particular, it will outline SQLite’s mechanism called virtual tables and showcase how we can use it from Rust programming language. In the end, we will have a working extension that can be dynamically loaded and used from SQLite. This…
GitHub – Florents-Tselai/WarcDB: WarcDB: Web crawl data as SQLite databases.
WarcDB: Web crawl data as SQLite databases. WarcDB is a an SQLite-based file format that makes web crawl data easier to share and query. It is based on the standardized Web ARChive format, used by web archivers. Usage # Load the `archive.warcdb` file with data. warcdb import archive.warcdb ./test…
Joining CSV and JSON data with an in-memory SQLite database
The new sqlite-utils memory command can import CSV and JSON data directly into an in-memory SQLite database, combine and query it using SQL and output the results as CSV, JSON or various other formats of plain text tables. sqlite-utils memory The new feature is part of sqlite-utils 3.10, which I …