docs(models): remove traditional ML (ONNX) inference (spiceai/spiceai#11684)#1914
Merged
Conversation
…#11684) PR #11684 deleted the model_components crate and all ONNX/Tract ML inference, including the /v1/predict and /v1/models/{name}/predict endpoints. Update the Models component, ML feature page, and spicepod models reference to reflect LLM-only model serving. The model 'datasets' field now scopes an LLM tool table allowlist (create_table_allowlist / with_table_patterns) rather than preselecting an ML inference dataset.
Contributor
✅ Pull with Spice PassedPassing checks:
|
Contributor
🔍 Pull with Spice FailedPassing checks:
Failed checks:
Please address these issues and update your pull request. |
Contributor
|
🚀 deployed to https://d4afcd3e.spiceai-org-website.pages.dev |
lukekim
approved these changes
Jul 9, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
spiceai/spiceai#11684deleted themodel_componentscrate and all traditional machine learning (ONNX/Tract) inference, including the/v1/predictand/v1/models/{name}/predictHTTP endpoints. Thespicedbuild no longer carries any ONNX dependency, and theModelType(ML vs LLM) distinction is gone — models are LLM-only.Verified against today's
origin/trunk(not just the merged diff):crates/model_componentsis gone,crates/runtime/src/http/v1/inference.rsis gone, nopredictroute remains inhttp/routes.rs, and no ONNX dependency exists inCargo.toml.This PR removes the now-inaccurate ONNX/traditional-ML documentation from the Models component and reference pages:
features/machine-learning-models/index.md— converted to a deprecation notice (page kept to avoid broken links; links to the v2.1 docs, which correctly document the feature for that release).components/models/index.md— dropped the now-emptyML Format(s)column; intro and local-model example updated to LLM-only.components/models/filesystem/{index,deployment}.md— removed the ONNX format clause, the ONNX example, the ONNX row in the supported-formats table, and the ONNX build-flavor mention.components/models/huggingface/{index,deployment}.md— removed the ONNX "predict taxi trips" example, the "ML models only support ONNX" limitation, and the ONNX quantized-format mention.reference/spicepod/models.md— LLM-only intro; thedatasetsfield now correctly documents its current behavior — an LLM tool table allowlist (create_table_allowlist/with_table_patternsincrates/runtime/src/model/nsql.rs), not ML-inference dataset preselection.getting-started/spicepods.md— "language or traditional ML models" → "language models".Versioned docs
vNext-only.
v2.1.x(the latest cut release) still ships ONNX and correctly documents it, so no versioned snapshots are edited.Out of scope (follow-ups)
components/models/spiceai.md(Spice Cloud Platform provider) still shows ML-inference examples and needs an LLM-usage rewrite — deferred pending confirmation of the currentspice.aiLLMfrom:form./v1/predictAPI pages (api/HTTP/get-model-predict.api.mdx,post-batch-predict.api.mdx) require regeneratingpublic/openapi.jsonvia the OpenAPI generator — a separate generator-driven change.ONNXformat entries (unrelated tomodel_components) and vision-prose mentions of ML predictions are better handled by a docs-accuracy review.Source PRs
Test plan
cd website && npm run buildpasses (DocusaurusonBrokenLinks: 'throw'; fixed one relative-link resolution)