Skip to content

[RHIDP-11190] Update Llama Stack To 0.3.5#24

Merged
Jdubrick merged 10 commits intoredhat-ai-dev:mainfrom
Jdubrick:update-0.3.4
Jan 14, 2026
Merged

[RHIDP-11190] Update Llama Stack To 0.3.5#24
Jdubrick merged 10 commits intoredhat-ai-dev:mainfrom
Jdubrick:update-0.3.4

Conversation

@Jdubrick
Copy link
Collaborator

What does this PR do?:

  • Updates Llama Stack to 0.3.5
  • Updates run.yaml to fit 0.3.x standards/syntax
  • Pulls in new RAG changes as experimental (will have JIRA issue for moving to official 'release-1.9' image when the docs are complete for 1.9)
  • Removes LCS safety shield for question validation -> replaced with Llama Guard in the interim (JIRA issue in progress for investigating alternatives/future of the safety we provide)
  • Added run-no-guard.yaml so we can test Llama Stack without needing the safety guardrails if we want
  • Updated readme structure/formatting and content

Which issue(s) this PR fixes:

https://issues.redhat.com/browse/RHIDP-11190

PR acceptance criteria:

Testing and documentation do not need to be complete in order for this PR to be approved. We just need to ensure tracking issues are opened and linked to this PR, if they are not in the PR scope due to various constraints.

  • Tested and Verified

  • Documentation (READMEs, Product Docs, Blogs, Education Modules, etc.)

How to test changes / Special notes to the reviewer:

Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>
Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>
Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>
Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>
Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>
Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>
Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>
Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>
Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>
Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>
@Jdubrick
Copy link
Collaborator Author

Ignore the CI failure, it will need to be adjusted since the piece it checks is no longer present

Copy link

@yangcao77 yangcao77 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

verified it works fine in my local env

@Jdubrick Jdubrick merged commit f49813c into redhat-ai-dev:main Jan 14, 2026
1 of 2 checks passed
Jdubrick added a commit that referenced this pull request Feb 10, 2026
* Conditionally Add All Inference Providers (#12)

* add all providers conditionally

Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>

* add vertex ai provider

Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>

---------

Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>

* [RHDHPAI-1170] Add Question Validation Prompt Template Sync Script (#11)

* add python script for syncing contents

Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>

* add CI for running validation on PRs

Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>

* add make commands for running script

Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>

* run the sync with upstream prompt templates

Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>

* cleanup whitespace

Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>

---------

Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>

* update rag items to 1.8 (#13)

Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>

* bump latest version in readme

Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>

* Update build commands readme.md, add cache info for local run in lightspeed-stack.yaml (#16)

Signed-off-by: Lucas <lyoon@redhat.com>

* [RHIDP-10054] Add YAML Formatter (#17)

* v0.0.0

* add Prettier for formatting and update docs

Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>

* resolve conflict and reformat

Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>

---------

Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>

* add default for vllm envs (#18)

Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>

* Konflux onboarding prep work (#19)

* add license

Signed-off-by: Michael Valdron <mvaldron@redhat.com>

* add license headers

Signed-off-by: Michael Valdron <mvaldron@redhat.com>

* add build step to add license file into container image

Signed-off-by: Michael Valdron <mvaldron@redhat.com>

* fix image tags and digests

Signed-off-by: Michael Valdron <mvaldron@redhat.com>

* run second build instruction as root

Signed-off-by: Michael Valdron <mvaldron@redhat.com>

* add enterprise contract labels for llama stack to image build

Signed-off-by: Michael Valdron <mvaldron@redhat.com>

* ignore existance errors from creating /license directory during image build

Signed-off-by: Michael Valdron <mvaldron@redhat.com>

* fix user switching order

Signed-off-by: Michael Valdron <mvaldron@redhat.com>

* include additional instructions about accessing host model server

Signed-off-by: Michael Valdron <mvaldron@redhat.com>

* feedback: remove extra descriptor for running locally

Signed-off-by: Michael Valdron <mvaldron@redhat.com>

* feedback: bump project version to match latest release version

Signed-off-by: Michael Valdron <mvaldron@redhat.com>

---------

Signed-off-by: Michael Valdron <mvaldron@redhat.com>

* add troubleshooting section (#20)

Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>

* update prompt template (#22)

Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>

* [RHIDP-11190] Update Llama Stack To 0.3.5 (#24)

* move to llama stack 0.3.4 and remove safety shield

Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>

* update readme with 0.3 info

Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>

* update lightspeed provider tag (could become redundant)

Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>

* update llama stack to 0.3.5

Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>

* update run.yaml to llama v0.3.x standard

Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>

* update mount reference to use 'rag-content'

Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>

* add llama guard

Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>

* overhaul readme

Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>

* update no guard run

Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>

* use experimental 1.8 rag build

Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>

---------

Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>

* update deployment doc (#25)

Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>

* prepare for 0.1.3 release

Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>

* update version in containerfile

Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>

---------

Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>
Signed-off-by: Lucas <lyoon@redhat.com>
Signed-off-by: Michael Valdron <mvaldron@redhat.com>
Co-authored-by: Maysun Faisal <31771087+maysunfaisal@users.noreply.github.com>
Co-authored-by: Lucas Yoon <94267691+JslYoon@users.noreply.github.com>
Co-authored-by: Michael Valdron <mvaldron@redhat.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants