Skip to content

Improved Incremental SPARQL imports#764

Merged
mmarx merged 81 commits intomainfrom
feature/sparql-merge-negation
Mar 17, 2026
Merged

Improved Incremental SPARQL imports#764
mmarx merged 81 commits intomainfrom
feature/sparql-merge-negation

Conversation

@mmarx
Copy link
Copy Markdown
Member

@mmarx mmarx commented Mar 2, 2026

Fixes #739, #740, #742, #756.

mmarx and others added 30 commits March 2, 2026 18:47
With the loading of, e.g., SPARQL queries happening asynchronously, we
won't get meaningful timings by tracking thread time (since we're
spending, e.g., 10 seconds waiting on an HTTP reply that would not be
counted at all).
What's still left is actually translating the patterns.
mmarx added 6 commits March 9, 2026 20:20
Flake lock file updates:

• Updated input 'crane':
    'github:ipetkov/crane/8525580bc0316c39dbfa18bd09a1331e98c9e463' (2026-02-26)
  → 'github:ipetkov/crane/db590d9286ed5ce22017541e36132eab4e8b3045' (2026-03-03)
• Updated input 'nixpkgs':
    'github:NixOS/nixpkgs/1267bb4920d0fc06ea916734c11b0bf004bbe17e' (2026-02-25)
  → 'github:NixOS/nixpkgs/fabb8c9deee281e50b1065002c9828f2cf7b2239' (2026-03-04)
• Updated input 'rust-overlay':
    'github:oxalica/rust-overlay/458eea8d905c609e9d889423e6b8a1c7bc2f792c' (2026-03-02)
  → 'github:oxalica/rust-overlay/629bbb7f9d02787a54e28398b411da849246253b' (2026-03-06)
Flake lock file updates:

• Updated input 'nixpkgs':
    'github:NixOS/nixpkgs/fabb8c9deee281e50b1065002c9828f2cf7b2239' (2026-03-04)
  → 'github:NixOS/nixpkgs/71caefce12ba78d84fe618cf61644dce01cf3a96' (2026-03-06)
• Updated input 'rust-overlay':
    'github:oxalica/rust-overlay/629bbb7f9d02787a54e28398b411da849246253b' (2026-03-06)
  → 'github:oxalica/rust-overlay/3c06fdbbd36ff60386a1e590ee0cd52dcd1892bf' (2026-03-09)
@mmarx mmarx force-pushed the feature/sparql-merge-negation branch from 0e76aa3 to db586bf Compare March 9, 2026 19:23
Copy link
Copy Markdown
Member

@monsterkrampe monsterkrampe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There are a few TODO comments left. I think they should either be addressed or removed. Maybe we could create follow up issues if necessary.

Comment thread nemo/src/execution/planning/strategy/forward/body.rs Outdated
Comment thread nemo/src/io/formats/sparql/functions.rs Outdated
Comment thread nemo/src/io/formats/sparql/queries.rs Outdated
Comment thread nemo/src/rule_model/components/import_export/clause.rs Outdated
@github-project-automation github-project-automation Bot moved this from Todo to In Progress in nemo Mar 10, 2026
mmarx added 6 commits March 16, 2026 15:24
Flake lock file updates:

• Updated input 'crane':
    'github:ipetkov/crane/db590d9286ed5ce22017541e36132eab4e8b3045' (2026-03-03)
  → 'github:ipetkov/crane/6fa2fb4cf4a89ba49fc9dd5a3eb6cde99d388269' (2026-03-11)
• Updated input 'nixpkgs':
    'github:NixOS/nixpkgs/71caefce12ba78d84fe618cf61644dce01cf3a96' (2026-03-06)
  → 'github:NixOS/nixpkgs/9fe1300f4360e13f39d6d1d006e54fd5093e9ad5' (2026-03-15)
• Updated input 'rust-overlay':
    'github:oxalica/rust-overlay/3c06fdbbd36ff60386a1e590ee0cd52dcd1892bf' (2026-03-09)
  → 'github:oxalica/rust-overlay/f600ea449c7b5bb596fa1cf21c871cc5b9e31316' (2026-03-16)
@mmarx mmarx force-pushed the feature/sparql-merge-negation branch from db586bf to 794d7a0 Compare March 16, 2026 18:50
@mmarx mmarx force-pushed the feature/sparql-merge-negation branch from 794d7a0 to ca9cee6 Compare March 16, 2026 21:48
Comment thread nemo/src/rule_model/components/import_export/clause.rs Outdated
Comment thread nemo/src/rule_model/components/import_export/clause.rs Outdated
@mmarx mmarx force-pushed the feature/sparql-merge-negation branch from a63ef4e to f3568ae Compare March 17, 2026 13:47
@mmarx mmarx requested a review from monsterkrampe March 17, 2026 13:48
@mmarx
Copy link
Copy Markdown
Member Author

mmarx commented Mar 17, 2026

This will need another rebase before merging to pull in nemo-{doc,web} with the right tags, but I don't expect any more code changes.

Copy link
Copy Markdown
Member

@monsterkrampe monsterkrampe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good. Thanks for addressing everything!

@mmarx mmarx force-pushed the feature/sparql-merge-negation branch from f3568ae to 2bd2ff4 Compare March 17, 2026 14:15
@mmarx
Copy link
Copy Markdown
Member Author

mmarx commented Mar 17, 2026

Actually, let's just do the release preparation on a different branch.

@mmarx mmarx merged commit eb131cf into main Mar 17, 2026
8 checks passed
@mmarx mmarx deleted the feature/sparql-merge-negation branch March 17, 2026 14:35
@github-project-automation github-project-automation Bot moved this from In Progress to Done in nemo Mar 17, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request io Input/Output rdf RDF support sparql SPARQL query support

Projects

Archived in project

Development

Successfully merging this pull request may close these issues.

Support multiple incremental imports in the same rule

3 participants