Skip to content

OpenFOIA v2.0.0 β€” The Safety Layer

Choose a tag to compare

@JordanCoin JordanCoin released this 22 Mar 16:36

OpenFOIA v2.0.0 β€” The Safety Layer

Everything from v1.0.0 plus a complete journalist safety toolkit.

New in v2.0.0

Entity Extraction (rewritten)

  • 4-tier extraction: LLM β†’ GLiNER β†’ spaCy β†’ Regex
  • GLiNER zero-shot NER: pip install openfoia[ner] β€” 90% entity recall, runs on CPU, no API key
  • Local LLM (ollama llama3.2:3b): 100% recall on FOIA documents in 26 seconds
  • Relationship extraction at every tier (co-occurrence, syntactic parsing, LLM)
  • E2E test suite with realistic FOIA documents and ground truth

Security

  • Encrypted storage at rest (SQLCipher AES-256) β€” openfoia init --password
  • Forensic purge β€” openfoia purge --secure (3-pass overwrite, history scrub, free space fill)
  • Automatic metadata stripping on ingest (EXIF, PDF author, DOCX revision history)
  • Duress mode β€” second password opens a decoy database with harmless data

OSINT

  • Web archive ingestion via Tor β€” openfoia ingest --url <url> --tor
  • Public records adapters: OpenCorporates + SEC EDGAR β€” openfoia records search "Acme Corp"
  • Agentic Tor browsing via Playwright β€” openfoia browse <url> --tor

Deployment

  • Air-gapped deployment docs (Tails OS, encrypted USB, Qubes)
  • OPENFOIA_DATA_DIR env var for portable installs

Install

curl -fsSL https://raw.githubusercontent.com/JordanCoin/openfoia/main/install.sh | bash

Uninstall

curl -fsSL https://raw.githubusercontent.com/JordanCoin/openfoia/main/uninstall.sh | bash

Your data never leaves your machine.