v4.1.0

What's Changed

• Update about.py by @sidmohan0 in #59
• feat(regex): Enhance regex patterns and tests for PII detection by @sidmohan0 in #65
• feat(text-service): Add engine selection and structured output by @sidmohan0 in #66
• Feat/benchmarks by @sidmohan0 in #67
• Run benchmarks on pushes and pull requests by @sidmohan0 in #68
• Feat/regex fallback by @sidmohan0 in #69
• Update setup.py by @sidmohan0 in #70
• runtime breakers by @sidmohan0 in #72
• Added integration test markers: by @sidmohan0 in #73
• Feat/cli smoke tests by @sidmohan0 in #74
• Feat/ocr flag by @sidmohan0 in #75
• Chore/housekeeping by @sidmohan0 in #76
• updated textservice to not catch empty strings by @sidmohan0 in #77
• Update setup.py by @sidmohan0 in #78
• fixed tagging issue by @sidmohan0 in #79
• fixed pypi by @sidmohan0 in #81
• reverting pypi to stable ver by @sidmohan0 in #82
• Cleanup/fix benchmark and ci issues by @sidmohan0 in #87
• refactor: replace speed claims with intelligent engine selection messaging by @sidmohan0 in #86
• fixed pypi.yml by @sidmohan0 in #88
• removed auto beta by @sidmohan0 in #89

Full Changelog: v4.0.0...v4.1.0

v4.0.0

What's Changed

• V4.0.0 by @sidmohan0 in #52
• Update setup.py by @sidmohan0 in #53

Full Changelog: v3.4.0...v4.0.0

v3.4.0

What's Changed

• fix link to the getting started collab notebook by @sroy9675 in #44
• remove extraneous debug prints by @sroy9675 in #45
• ff by @sidmohan0 in #46
• Feature/update example notebooks by @sidmohan0 in #47
• cleanup by @sidmohan0 in #48
• _chunk_text + tests by @sidmohan0 in #49
• Remove all .venv files and example.venv files and error_log.txt ... by @pselvana in #50
• python 3.10, 3.11, 3.12 support | model by @sidmohan0 in #51

New Contributors

• @pselvana made their first contribution in #50

Full Changelog: v3.3.0...v3.4.0

v3.3.0

What's Changed

• Recovered 3.2.2 by @sidmohan0 in #33
• Temp update cicd by @sidmohan0 in #35
• pre-commit passed by @sidmohan0 in #36
• updated ymls by @sidmohan0 in #37
• Add Synchronous processing by @sroy9675 in #32
• publish-pypi.yml by @sidmohan0 in #40
• Hotfix/spacy pypi issue by @sidmohan0 in #41
• updated publish-pypi to remove en-spacy-pii-fast install by @sidmohan0 in #42

New Contributors

• @sroy9675 made their first contribution in #32

Full Changelog: v3.2.1...v3.3.0

v.3.2.1

Moved PySpark as an optional dependency (faster install)
OpenTelemetry implementation (logging to support dev priorities)

v3.2.0: Improved OCR, streamlined functions, and more

First - thanks everyone for bearing with us as we've made some notable architectural changes over the past several releases.
A big part of doing this was orienting the package towards better long-term development and where DataFog is being used today and likely in the future within API services.

• Implement Pytesseract: significant speed and accuracy in OCR text extraction from Donut!
  • Allows for better image and PDF extraction
• Enhanced test suite coverage
• Refactored definitions to support async (for API integration)
• Refactored classes/functions around ImageService, TextService, SparkService

v3.1.0

• Refactored some user flow inefficiencies
• Updated user flows incl pyspark usage in README

v3.0.1

HuggingFaces 🤗 integration!
for V3 based on feedback we want to include more support for OCR -> PII annotation
Dedicated flows to support multi-step NLP processing
Pydantic type checking, improved

v2.3.2

What's Changed

• v2.0.0alpha1 by @sidmohan0 in #1
• v2.0.1 : updated function methods, README with a Getting Started Section by @sidmohan0 in #2
• V2.2.0 beta1 by @sidmohan0 in #5
• updating dev with current codebase by @sidmohan0 in #6
• V2.3.1 by @sidmohan0 in #12
• V2.3.2 by @sidmohan0 in #13
• updated README.MD by @sidmohan0 in #14

Full Changelog: https://github.com/DataFog/datafog-python/commits/v2.3.2