SoMark open-sources OXR-1.0, a 1.3B-parameter document parser
Summary
SoMark has open-sourced OXR-1.0, a document parsing model with 1.3 billion parameters, which excels at converting PDFs and page images into Markdown or JSON formats. It uniquely employs a recursive self-improvement (RSI) training loop that independently identifies and rectifies its parsing mistakes without human labeling. This innovative approach allows for efficient retraining of the model by utilizing a general vision language model (VLM) that clusters and generates new training data based on detected weaknesses. OXR-1.0 is noted for its rapid performance, parsing 100 pages in approximately 101 seconds, making it significantly faster than competing models, while outputting 13 structured element types including tables and mathematical formulas in LaTeX. The model's design separates layout detection from content recognition, enabling customizable layout handling for diverse document types.