-
Notifications
You must be signed in to change notification settings - Fork 236
tune python demo to use public image #3908
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Pull request overview
This PR updates documentation to reference public Docker images instead of requiring users to build images locally. The change simplifies the setup process by removing build instructions and updating Docker image references to use the publicly available openvino/model_server:latest-py tag.
Changes:
- Removed local Docker image build instructions from documentation
- Updated Docker image references from
openvino/model_server:pytoopenvino/model_server:latest-py
Reviewed changes
Copilot reviewed 2 out of 2 changed files in this pull request and generated 1 comment.
| File | Description |
|---|---|
| demos/python_demos/clip_image_classification/README.md | Removed build instructions section and updated Docker run command to use public image tag |
| demos/continuous_batching/rag/README.md | Removed build instructions and updated multiple Docker run commands to use public image tag |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
| docker run --user $(id -u):$(id -g) --rm -v $(pwd)/models:/models:rw openvino/model_server:py --add_to_config --config_path /models/config.json --model_name meta-llama/Meta-Llama-3-8B-Instruct --model_path meta-llama/Meta-Llama-3-8B-Instruct --weight-format int8 | ||
| docker run --user $(id -u):$(id -g) --rm -v $(pwd)/models:/models:rw openvino/model_server:py --add_to_config --config_path /models/config.json --model_name Alibaba-NLP/gte-large-en-v1.5 --model_path Alibaba-NLP/gte-large-en-v1.5 --weight-format int8 | ||
| docker run --user $(id -u):$(id -g) --rm -v $(pwd)/models:/models:rw openvino/model_server:py --add_to_config --config_path /models/config.json --model_name BAAI/bge-reranker-large --model_path BAAI/bge-reranker-large --weight-format int8 | ||
| docker run --user $(id -u):$(id -g) --rm -v $(pwd)/models:/models:rw openvino/model_server:-latest-py --add_to_config --config_path /models/config.json --model_name meta-llama/Meta-Llama-3-8B-Instruct --model_path meta-llama/Meta-Llama-3-8B-Instruct --weight-format int8 |
Copilot
AI
Jan 14, 2026
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The Docker image tag has an extra hyphen (:- latest-py instead of :latest-py). This will cause the Docker command to fail as the image tag is malformed.
| docker run --user $(id -u):$(id -g) --rm -v $(pwd)/models:/models:rw openvino/model_server:-latest-py --add_to_config --config_path /models/config.json --model_name meta-llama/Meta-Llama-3-8B-Instruct --model_path meta-llama/Meta-Llama-3-8B-Instruct --weight-format int8 | |
| docker run --user $(id -u):$(id -g) --rm -v $(pwd)/models:/models:rw openvino/model_server:latest-py --add_to_config --config_path /models/config.json --model_name meta-llama/Meta-Llama-3-8B-Instruct --model_path meta-llama/Meta-Llama-3-8B-Instruct --weight-format int8 |
|
|
||
|  | ||
|
|
||
| ## Build image |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
"git clone" and "cd model_server" commands are required by later steps
🛠 Summary
CVS-179161
🧪 Checklist
``