[ADD] ai_document_extraction by volkantasci · Pull Request #96 · OCA/ai

volkantasci · 2026-08-06T03:25:05Z

Add the ai_document_extraction module: local OCR (PaddleOCR) + LLM (Ollama) invoice data extraction into draft account.move records.

Features

OpenCV image pre-processing (grayscale, CLAHE, denoise, Otsu, resize)
PaddleOCR with layout tags ([HEADER]/[BODY]/[FOOTER] from bounding boxes)
OpenAI-compatible LLM extraction (qwen3:4b via Ollama) with a strict JSON schema, logo/header guard and hallucination controls (no math, null for unknown)
Async processing through queue_job (non-blocking UI)
rapidfuzz fuzzy partner matching (threshold configurable)
Extraction wizard for the partner-fallback flow
Configurable via res.config.settings (API base URL, model, OCR language, match threshold)
Full i18n (POT) and OCA scaffolding (readme fragments, license, security)

Notes

External deps (paddleocr, rapidfuzz, etc.) are declared in the manifest / repo requirements.txt; cv2 is imported lazily and documented in readme/INSTALL.md since cv2 is not a valid PyPI distribution name for CI.
Tests mock the OCR/LLM at the service boundary, so CI needs no model downloads.
Depends on queue_job (OCA/queue, 19.0).

volkantasci · 2026-08-11T16:37:10Z

Updated the documentation (commit 1ee7c6e) to match the vision-LLM pipeline already implemented in the code: INSTALL.md now lists Pillow/pdf2image/requests instead of the removed PaddleOCR/OpenCV dependencies, and the readme no longer claims OCR is used. Describes running a vision model via Ollama (qwen3-vl) or a cloud provider (OpenRouter).

volkantasci · 2026-08-12T15:22:21Z

Hi @etobella and @angelmoya 👋

Just a friendly ping — when you have a moment, could you take a look at this PR whenever convenient? All CI checks are green (pre-commit, Odoo/OCB tests, codecov, runboat).

Happy to adjust anything based on your feedback. Thanks so much for your time and all the maintenance work!

etobella · 2026-08-13T08:38:45Z

Interesting, however, why don't you use https://github.com/OCA/ai/tree/18.0/ai_connection ? This way we can reuse code and so on.

volkantasci · 2026-08-13T15:23:33Z

Hi @etobella, thanks for the suggestion! Following up on your feedback:

We ported ai_connection (and its dependency ai_tool) to 19.0 in a separate PR — #100 — and refactored ai_document_extraction to use it:

Provider config (URL / model / API key) now lives on ai.connection records via a new openai_compatible kind, with an AiOpenAICompatibleClient (OpenAI-compatible /chat/completions, Ollama num_ctx/keep_alive auto-detected from the URL).
res.config.settings now links an AI Connection instead of storing API fields; extraction-only settings (fuzzy_match_threshold) remain.
The extraction job routes through connection._run(...); retry behavior on empty/unparseable responses is preserved.

All 85 tests pass across ai_tool, ai_connection, and ai_document_extraction; pre-commit and CI are green. Happy to adjust anything else.

volkantasci · 2026-08-13T17:02:17Z

Quick update on the final UX since my previous comment (relevant for review):

The AI configuration no longer lives in General Settings: it is a small settings form under Settings > Technical > AI > AI Document Extraction, right next to AI Connection. It links the connection to use and the partner-match threshold, and keeps General Settings clean.
Fixed an Odoo 19 edge case: get_values() returning integer 0 for the unset ai_connection_id Many2one created a phantom record that crashed the settings onchange with 'int' object has no attribute 'origin'. It now returns False and is covered by a regression test.
The settings transient follows the OCA convention and lives in wizards/.

All green: 78 local tests, CI (pre-commit, Odoo/OCB, codecov, runboat).

volkantasci · 2026-08-17T17:43:26Z

Hi @etobella 👋 gentle follow-up — whenever you have a moment.

Where things stand: per your suggestion, ai_connection (and ai_tool) has been ported to 19.0 in #100, and this PR now builds on top of it — provider config on ai.connection records, the extraction job routed through connection._run(...), settings linked to an ai.connection. All CI is green.

This module is the foundation of a broader AI-integration effort we're preparing: several more OCA modules will consume the same connection layer, with new features arriving as separate PRs and branches. Your review direction here would be especially valuable — the sooner the design is aligned, the easier those follow-ups will be to review.

Happy to adjust anything. Thanks for your time!

volkantasci · 2026-08-26T07:57:06Z

Hi @etobella 👋

Per your suggestion, ai_connection/ai_tool are now in #100 and this PR has been refactored to use connection._run(...) (provider config on ai.connection, settings moved to Technical > AI). All 85 tests green.

#100 is the blocker for a clean rebase here - once it is merged I will rebase this one to remove the duplicated commits. Happy to adjust anything else in the meantime.

Thanks!

volkantasci · 2026-09-01T16:32:56Z

Note: #100 was restructured per the OCA migration guidelines into two per-module migration PRs: #110 (ai_tool) and #111 (ai_connection, stacked). I will rebase this PR once both merge.

Currently translated at 100.0% (14 of 14 strings) Translation: ai-18.0/ai-18.0-ai_connection Translate-URL: https://translation.odoo-community.org/projects/ai-18-0/ai-18-0-ai_connection/it/

volkantasci · 2026-09-04T14:22:45Z

Conflict resolved.

Rebased onto the current 19.0 tip and removed two commits that did not belong to this PR:

[ADD] ai_tool — ai_tool is already merged upstream (this was the merge conflict).
[ADD] ai_connection — ai_connection is tracked separately in [19.0][MIG] ai_connection: Migration to 19.0 #111.

The branch now contains only ai_document_extraction (plus the repo-level requirements.txt / checklog-odoo.cfg / eslint.config.cjs adjustments it needs).

Note on CI: the test jobs currently fail only because ai_connection 19.0 has not been released yet (Could not find a version that satisfies odoo-addon-ai_connection==19.0.*). This PR depends on #111 — once that merges and ai_connection is available, the install/tests here should go green.

hhgabelgaard · 2026-10-25T08:55:20Z

+                from pdf2image import convert_from_path
+
+                images = convert_from_path(
+                    file_path, dpi=200, first_page=1, last_page=1


This works fine for single page invoices. Tested locally with great results. But what about multi page invoices? As of now, we only get the details from the first page

etobella · 2026-08-13T08:35:11Z

+class AccountMove(models.Model):
+    _inherit = "account.move"
+
+    invoice_date = fields.Date(


Why this field? We already have the field in odoo, isn't it?

etobella · 2026-10-25T11:14:55Z

+    )
+    temperature = fields.Float(default=0.0)
+
+    def _get_client_openai_compatible(self, tools):


Is this necessary here?

etobella · 2026-10-25T11:17:02Z

+        return result
+
+    def action_extract_with_ai(self):
+        self.ensure_one()


I would recommend a completly different approach. You define a connection on journal or company (Up to you). And then, here you add the extracion process by using the file. You could reuse some toolings for getting the images or something like that. For me that would be much more clean.

OCA-git-bot added series:19.0 mod:ai_document_extraction Module ai_document_extraction labels Aug 6, 2026

volkantasci force-pushed the 19.0-ai-document-extraction branch from 3f64a21 to 0c759e6 Compare August 13, 2026 15:23

OCA-git-bot added mod:ai_tool Module ai_tool mod:ai_connection Module ai_connection labels Aug 13, 2026

volkantasci mentioned this pull request Aug 26, 2026

[19.0][ADD] ai_tool, ai_connection #100

Closed

volkantasci closed this Aug 30, 2026

volkantasci reopened this Aug 30, 2026

etobella and others added 5 commits September 1, 2026 19:42

[ADD] ai_connection

8ab81a9

[UPD] Update ai_connection.pot

8f03a85

[BOT] post-merge updates

fcddd1d

Added translation using Weblate (Italian)

887366b

Translated using Weblate (Italian)

c108872

Currently translated at 100.0% (14 of 14 strings) Translation: ai-18.0/ai-18.0-ai_connection Translate-URL: https://translation.odoo-community.org/projects/ai-18-0/ai-18-0-ai_connection/it/

volkantasci force-pushed the 19.0-ai-document-extraction branch from 512d23f to 985f034 Compare September 4, 2026 14:20

OCA-git-bot removed mod:ai_tool Module ai_tool mod:ai_connection Module ai_connection labels Sep 4, 2026

volkantasci mentioned this pull request Sep 4, 2026

[19.0][MIG] ai_connection: Migration to 19.0 #111

Open

hhgabelgaard reviewed Oct 25, 2026

View reviewed changes

etobella reviewed Oct 25, 2026

View reviewed changes

volkantasci force-pushed the 19.0-ai-document-extraction branch 2 times, most recently from 4e03b75 to 83b3bd1 Compare October 26, 2026 12:58

OCA-git-bot added the mod:ai_connection Module ai_connection label Oct 26, 2026

[MIG] ai_connection: Migration to 19.0

4cb84ad

volkantasci force-pushed the 19.0-ai-document-extraction branch 3 times, most recently from 601cd36 to 767a3ea Compare October 26, 2026 13:40

[ADD] ai_document_extraction: extract invoice data with vision LLMs

30cccad

volkantasci force-pushed the 19.0-ai-document-extraction branch from 767a3ea to 30cccad Compare October 26, 2026 13:46

Conversation

volkantasci commented Aug 6, 2026

Features

Notes

Uh oh!

volkantasci commented Aug 11, 2026

Uh oh!

volkantasci commented Aug 12, 2026

Uh oh!

etobella commented Aug 13, 2026

Uh oh!

volkantasci commented Aug 13, 2026

Uh oh!

volkantasci commented Aug 13, 2026

Uh oh!

volkantasci commented Aug 17, 2026

Uh oh!

volkantasci commented Aug 26, 2026

Uh oh!

volkantasci commented Sep 1, 2026

Uh oh!

volkantasci commented Sep 4, 2026

Uh oh!

hhgabelgaard Oct 25, 2026

Choose a reason for hiding this comment

Uh oh!

etobella Aug 13, 2026

Choose a reason for hiding this comment

Uh oh!

etobella Oct 25, 2026

Choose a reason for hiding this comment

Uh oh!

etobella Oct 25, 2026

Choose a reason for hiding this comment

Uh oh!

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants