Skip to content

Releases: VikParuchuri/marker

OCR and misc improvements; demo app

19 Aug 21:30
97ce051
Compare
Choose a tag to compare
  • Language no longer needs to be specified
  • Fix OCR memory leak
  • Add marker GUI demo app to test out conversion
  • Add progress for equation detection
  • Improve table recognition slightly
  • Add table benchmark

Significant speedup

12 Jul 18:04
054fac1
Compare
Choose a tag to compare

This release has a 15% GPU speedup, 3x CPU, 7x MPS. The speedup comes from new surya models for layout and text detection that are a lot more efficient.

This is a "best case" speedup, if you need to OCR or do equation recognition, the speedup will be lower. But it will still be a lot faster.

Fix transformers bugs

30 Jun 15:20
0f792b5
Compare
Choose a tag to compare
  • New transformers version introduces a new kwarg in donut models. Handle this case by ignoring it.
  • New transformers version breaks MPS compatibility by using torch .isin to do a comparison. Handle this by setting the pytorch mps fallback setting.

Pagination, bug fixes

17 Jun 17:04
fe9343c
Compare
Choose a tag to compare
  • Add a setting to enable output pagination
  • Enable convert.py to use mps (but less memory efficient than cpu/cuda)
  • Fix bug with inference ram setting
  • Fix bug with pdf names with dots in them
  • Fix bug with images at the end of blocks

Fix convert.py bug

30 May 01:55
53125ac
Compare
Choose a tag to compare

Fix model device check.

Specify page range

29 May 18:09
aa8e7f0
Compare
Choose a tag to compare
  • Make it more clear MPS can't be used with convert.py
  • Specify page range in convert with start_page and max_pages

Python 3.12 compatibility

28 May 22:36
a3334ce
Compare
Choose a tag to compare
  • Remove ray to enable python 3.12 compatibility
  • Removing ray frees a lot of VRAM (since we can use torch shared tensors), so on average with convert.py each process takes 3GB VRAM. This enables much higher throughput (was between 4.5GB and 5GB before).

OCR speedups

28 May 04:34
7bf2e91
Compare
Choose a tag to compare
  • Pull in new surya and pdftext versions for speedups in OCR and text extraction, respectively
  • Refine heuristics to reduce OCR false positives (and true positives, unfortunately)
  • Enable float batch multipliers

Speed improvements

23 May 23:24
0d9b0db
Compare
Choose a tag to compare
  • Enable parallel text extraction, with worker count settings
  • Bump surya version to pull in layout/line segmentation speed improvements, and OCR bug fix

Faster OCR

18 May 04:28
cc9d830
Compare
Choose a tag to compare
  • OCR is now ~2.5x faster, due to improvements in surya