Skip to content

Add provider abstraction #264

@besaleli

Description

@besaleli

Current implementation assumes ONNX runtime. Down the line we should be able to give option for other providers.

Implementation: add another generic parameter to AppState that implements Inference trait.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions