simplepyetl

Boilerplate ETL project using PySpark

Installation

pip install -e .

Development Setup

1. Create virtual environment
2. Install development dependencies:

   pip install -r requirements-dev.txt

3. Install package in editable mode:

   pip install -e .

Usage

from simplepyetl import split_first_last_name

Testing

Run tests:

python -m unittest discover -s tests

GitHub Actions

Automated unit testing runs on push and pull requests via .github/workflows/test_unittest.yaml.