From 21eaf5b3e9f2acf2b90ba6664831f8e6c0ebc2d5 Mon Sep 17 00:00:00 2001 From: pagezyhf Date: Thu, 11 Dec 2025 16:19:22 +0100 Subject: [PATCH 1/4] draft --- _blog.yml | 9 +++++++- deh-2025.md | 62 +++++++++++++++++++++++++++++++++++++++++++++++++++++ 2 files changed, 70 insertions(+), 1 deletion(-) create mode 100644 deh-2025.md diff --git a/_blog.yml b/_blog.yml index 6840c611a6..38b96003cf 100644 --- a/_blog.yml +++ b/_blog.yml @@ -4992,4 +4992,11 @@ - Claude - Codex - Gemini - - agents \ No newline at end of file + - agents + +- local: deh-2025 + date: Dec 11, 2025 + tags: + - announcement + - dell + - partnerships diff --git a/deh-2025.md b/deh-2025.md new file mode 100644 index 0000000000..20bdaf5c8a --- /dev/null +++ b/deh-2025.md @@ -0,0 +1,62 @@ +--- +title: "What's new in Dell Enterprise Hub" +thumbnail: /blog/assets/dell-enterprise-hub/thumbnail.jpg +authors: + - user: pagezyhf +--- + +# What’s new in Dell Enterprise Hub: security, performance, and lifecycle at scale + +![Dell Enterprise Hub updates](/blog/assets/dell-enterprise-hub/thumbnail.jpg) + +A year ago we introduced the [Dell Enterprise Hub](https://dell.huggingface.co), a new experience on Hugging Face to make it easy to train and deploy open models on-premise using Dell platforms. + +Since that launch, Dell Enterprise Hub has grown from a model catalog into a full on-prem AI experience: you can browse open models, deploy them on Dell AI servers and AI PCs with optimized configurations, fine-tune them with your own data, and, more recently, even deploy complete AI applications through the Application Catalog. + +Today we are introducing the next wave of capabilities, focused on three things that matter a lot to enterprises: **supply chain security, lifecycle management, and real-world performance**. + +You can try all of this today at [dell.huggingface.co](https://dell.huggingface.co). + +## Securing the AI supply chain + +As more AI workloads move into production, teams care not just about which model they use, but also about how it gets into their infrastructure. What is inside the Docker image? Has the model repository been scanned? How are the weights pulled into the cluster? The new Dell Enterprise Hub experience brings these questions into the product itself, so platform, security and ML teams can share the same view. + +Every model on the Hugging Face Hub is scanned for malware and unsafe serialization formats. Dell Enterprise Hub now surfaces a summary of these **repository scan results** directly in the model view. This gives security and compliance teams a starting point for their own reviews, without forcing them to hunt for the right tab or URL. + +![Model scan results](https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/deh-2025/model-scan-results.png) + +Models are only one piece of the supply chain. The container image that runs those models also needs to be monitored. Dell Enterprise Hub uses custom Docker images for inference and training, optimized per model and per Dell platform. These images are regularly scanned with AWS Inspector, and Dell Enterprise Hub now exposes **container scan status** alongside the deployment configuration. + +![Container scan status](https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/deh-2025/container-scan-status.png) + +To better govern model access, Dell Enterprise Hub now standardizes the use of **Hugging Face access tokens** in its deployment snippets. Token authenticates your calls to the Hub, ensures access to gated models is respected, and gives you higher rate limits when pulling model weights. + +![HF Token](https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/deh-2025/hf-token.png) + +Together, these features give Dell Enterprise Hub users a simpler, more transparent way to secure their AI supply chain. + +## Good performance on day one + +Once security is in place, the next question is performance. The goal for Dell Enterprise Hub is that you get solid performance for your chosen model and Dell hardware from day one, without having to become an expert in every inference engine and tuning parameter. + +Dell Enterprise Hub started with containers built on top of Hugging Face **Text Generation Inference (TGI)**. Today, it can also choose engines like **vLLM** or **SGLang** based on the model and platform, and it generates deployment snippets with sensible default parameters. You pick the model and Dell platform; Dell Enterprise Hub picks a runtime and configuration that work well out of the box. + +Looking ahead, Dell Enterprise Hub will become more opinionated about the default configuration parameters included in each deployment snippet, with presets for different use cases. You will still be able to override any of these values in the generated command if you want to experiment, but the goal is that teams get strong results on day one by simply copying the snippet into their Dell environment. + +## Lifecycle: decoupling containers and versioning + +The last big theme in this update is how Dell Enterprise Hub handles the lifecycle of containers and model weights over time. Enterprises need to patch base images, upgrade inference engines, rotate models and archive older assets, often under strict compliance requirements. To make that easier, Dell Enterprise Hub is moving to a **decoupled container architecture with explicit versioning**. + +Historically, many Dell Enterprise Hub images shipped with the model weights baked directly into the container. This made “first run” very simple, but it also led to large images and tighter coupling between the model and the runtime environment. From now on, new containers added to Dell Enterprise Hub are provided **without pre-downloaded weights**. The container includes the inference engine and all dependencies; the weights are pulled separately. + +Additionnaly, instead of relying on a single `latest` tag for containers, Dell Enterprise Hub now exposes **versioned tags**. This means you can pin an exact container tag in production, test a newer container in staging, and move between them on your own schedule. + +![Container Versioning](https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/deh-2025/container-versioning.png) + +## What’s next + +These changes are another step toward making Dell Enterprise Hub the easiest way to run open models and applications on Dell infrastructure, fully on-premise and under your control. + +We are continuing to expand support for new modalities and new Dell platforms, to refine default configurations around real-world goodput, and to deepen the integration between the Model Catalog, Application Catalog, Hugging Face Hub and programmatic tools. + +We are excited to keep building open, on-prem AI together! From 547d0c68a297d547228aa154dd885a3213811d79 Mon Sep 17 00:00:00 2001 From: pagezyhf <165770107+pagezyhf@users.noreply.github.com> Date: Fri, 12 Dec 2025 11:12:31 +0100 Subject: [PATCH 2/4] Apply suggestion from @jeffboudier Co-authored-by: Jeff Boudier <74218629+jeffboudier@users.noreply.github.com> --- _blog.yml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/_blog.yml b/_blog.yml index 38b96003cf..63661b2416 100644 --- a/_blog.yml +++ b/_blog.yml @@ -4994,7 +4994,7 @@ - Gemini - agents -- local: deh-2025 +- local: dell-enterprise-security date: Dec 11, 2025 tags: - announcement From c40cd63f9fdc0ffa910f4fb10a1949f1ed002f39 Mon Sep 17 00:00:00 2001 From: pagezyhf <165770107+pagezyhf@users.noreply.github.com> Date: Fri, 12 Dec 2025 11:33:23 +0100 Subject: [PATCH 3/4] Apply suggestions from code review Co-authored-by: Jeff Boudier <74218629+jeffboudier@users.noreply.github.com> Co-authored-by: Alvaro Bartolome <36760800+alvarobartt@users.noreply.github.com> --- deh-2025.md | 43 +++++++++++++++++++++++-------------------- 1 file changed, 23 insertions(+), 20 deletions(-) diff --git a/deh-2025.md b/deh-2025.md index 20bdaf5c8a..af2ba8b600 100644 --- a/deh-2025.md +++ b/deh-2025.md @@ -1,27 +1,30 @@ --- -title: "What's new in Dell Enterprise Hub" +title: "Security and Performance for Dell On-Prem AI Builders" thumbnail: /blog/assets/dell-enterprise-hub/thumbnail.jpg authors: - user: pagezyhf + - user: alvarobartt + - user: juanjucm + - user: jeffboudier --- -# What’s new in Dell Enterprise Hub: security, performance, and lifecycle at scale +# Security, Governance and Performance Updates for Dell On-Prem AI Builders ![Dell Enterprise Hub updates](/blog/assets/dell-enterprise-hub/thumbnail.jpg) -A year ago we introduced the [Dell Enterprise Hub](https://dell.huggingface.co), a new experience on Hugging Face to make it easy to train and deploy open models on-premise using Dell platforms. +A year ago we introduced the [Dell Enterprise Hub](https://dell.huggingface.co), a new experience from Hugging Face to make it easy to train and deploy open models on-premise using Dell platforms. Since that launch, Dell Enterprise Hub has grown from a model catalog into a full on-prem AI experience: you can browse open models, deploy them on Dell AI servers and AI PCs with optimized configurations, fine-tune them with your own data, and, more recently, even deploy complete AI applications through the Application Catalog. -Today we are introducing the next wave of capabilities, focused on three things that matter a lot to enterprises: **supply chain security, lifecycle management, and real-world performance**. +Today we are introducing the next wave of capabilities, focused on three things that matter a lot to enterprises: **security, governance, and performance**. -You can try all of this today at [dell.huggingface.co](https://dell.huggingface.co). +All the new features discussed below are available today - try them on [dell.huggingface.co](https://dell.huggingface.co). ## Securing the AI supply chain -As more AI workloads move into production, teams care not just about which model they use, but also about how it gets into their infrastructure. What is inside the Docker image? Has the model repository been scanned? How are the weights pulled into the cluster? The new Dell Enterprise Hub experience brings these questions into the product itself, so platform, security and ML teams can share the same view. +As more AI workloads move into production, teams care not just about which model they use, but also about how it gets into their infrastructure. What is inside the Docker image? Has the model repository been scanned? How are the weights pulled into the cluster? The new Dell Enterprise Hub experience answers these questions directly on the model page so that AI, infrastructure and security teams all have access to transparent information. -Every model on the Hugging Face Hub is scanned for malware and unsafe serialization formats. Dell Enterprise Hub now surfaces a summary of these **repository scan results** directly in the model view. This gives security and compliance teams a starting point for their own reviews, without forcing them to hunt for the right tab or URL. +Every model on the Hugging Face Hub is scanned for malware and unsafe serialization formats. Dell Enterprise Hub now surfaces a summary of these **repository scan results** directly in the model view. This gives security and compliance teams a starting point for their own reviews, without having to go into deep investigation. ![Model scan results](https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/deh-2025/model-scan-results.png) @@ -29,34 +32,34 @@ Models are only one piece of the supply chain. The container image that runs tho ![Container scan status](https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/deh-2025/container-scan-status.png) -To better govern model access, Dell Enterprise Hub now standardizes the use of **Hugging Face access tokens** in its deployment snippets. Token authenticates your calls to the Hub, ensures access to gated models is respected, and gives you higher rate limits when pulling model weights. +To enable Enterprises to implement model access governance, Dell Enterprise Hub now standardizes the use of **Hugging Face access tokens** in its deployment experiences. HF Tokens authenticate your calls to the Hub, ensure access permissions to gated models are respected, and give users higher rate limits when pulling model weights from Hugging Face. ![HF Token](https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/deh-2025/hf-token.png) -Together, these features give Dell Enterprise Hub users a simpler, more transparent way to secure their AI supply chain. +Together, these features enable enterprises to build their own AI on-premises with improved security and governance. Dell Enterprise Hub offers a simple, transparent way to secure the AI model supply chain and govern model access. -## Good performance on day one +## Performance out of the box -Once security is in place, the next question is performance. The goal for Dell Enterprise Hub is that you get solid performance for your chosen model and Dell hardware from day one, without having to become an expert in every inference engine and tuning parameter. +Once the security posture is in a good place, the next question is performance. The goal for Dell Enterprise Hub is to offer performance out of the box with optimized configurations for each combination of model and Dell system, without having to fiddle with every inference engine and deployment parameter. -Dell Enterprise Hub started with containers built on top of Hugging Face **Text Generation Inference (TGI)**. Today, it can also choose engines like **vLLM** or **SGLang** based on the model and platform, and it generates deployment snippets with sensible default parameters. You pick the model and Dell platform; Dell Enterprise Hub picks a runtime and configuration that work well out of the box. +When we launched Dell Enterprise Hub in May 2024, most model deployment containers were built on top of Hugging Face **Text Generation Inference (TGI)**. Today, each model is offered with the best available runtime, including **vLLM** or **SGLang** engines based on the model and Dell system, and the model deployment code snippets are preconfigured with tested parameters. You pick the model and Dell platform; Dell Enterprise Hub picks a runtime and configuration that works well out of the box. -Looking ahead, Dell Enterprise Hub will become more opinionated about the default configuration parameters included in each deployment snippet, with presets for different use cases. You will still be able to override any of these values in the generated command if you want to experiment, but the goal is that teams get strong results on day one by simply copying the snippet into their Dell environment. +Looking ahead, Dell Enterprise Hub will offer more opinionated choices defining the default configuration parameters for each deployment snippet, with presets for different use cases. You will still be able to override any of these values in the generated command to experiment, with the goal that teams get strong results out of the box by simply copying the code snippet into their Dell environment or using the [dell-ai CLI](https://github.com/huggingface/dell-ai). -## Lifecycle: decoupling containers and versioning +## Lifecycle: Containers versioning and decoupling model weights -The last big theme in this update is how Dell Enterprise Hub handles the lifecycle of containers and model weights over time. Enterprises need to patch base images, upgrade inference engines, rotate models and archive older assets, often under strict compliance requirements. To make that easier, Dell Enterprise Hub is moving to a **decoupled container architecture with explicit versioning**. +Another major update in Dell Enterprise Hub is the introduction of container versioning, and the decoupling of containers and model weights, to improve AI developer experience and lifecycle management. Without Dell Enterprise Hub, enterprises need to continuously patch base images, upgrade inference engines, rotate models and archive older assets, often under strict compliance requirements. To make that easier, Dell Enterprise Hub now implements **decoupled container architecture with explicit versioning**. -Historically, many Dell Enterprise Hub images shipped with the model weights baked directly into the container. This made “first run” very simple, but it also led to large images and tighter coupling between the model and the runtime environment. From now on, new containers added to Dell Enterprise Hub are provided **without pre-downloaded weights**. The container includes the inference engine and all dependencies; the weights are pulled separately. +Historically, many Dell Enterprise Hub containers shipped with the model weights within the container. This made the “first run” very straightforward, but it also led to large images and tighter coupling between the model and the runtime environment. From now on, new containers added to Dell Enterprise Hub are provided **without pre-downloaded weights, by default pulled from the Hugging Face Hub on runtime**. If required, it is still possible to download the model weights in advance and mount them into the container. -Additionnaly, instead of relying on a single `latest` tag for containers, Dell Enterprise Hub now exposes **versioned tags**. This means you can pin an exact container tag in production, test a newer container in staging, and move between them on your own schedule. +Additionnaly, instead of relying on a single `latest` tag for containers, Dell Enterprise Hub now exposes **versioned tags**. This means you can pin an exact container tag in production, test a newer container in staging, and move between them on your own schedule. The tags include the inference engine name and version to make debugging and experimentation more transparent. ![Container Versioning](https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/deh-2025/container-versioning.png) ## What’s next -These changes are another step toward making Dell Enterprise Hub the easiest way to run open models and applications on Dell infrastructure, fully on-premise and under your control. +These changes are another step towards making Dell Enterprise Hub the easiest way to run open models and applications on Dell platforms, fully on-premise and under your control. -We are continuing to expand support for new modalities and new Dell platforms, to refine default configurations around real-world goodput, and to deepen the integration between the Model Catalog, Application Catalog, Hugging Face Hub and programmatic tools. +We will continue to add support for new models, new modalities and new Dell platforms. Expect improved configurations built around real-world latency and throughput requirements, and a deeper integration between the Dell Enterprise Hub and Hugging Face Enterprise. -We are excited to keep building open, on-prem AI together! +To follow along, make sure to follow the [Dell Technologies organization](https://huggingface.co/DellTechnologies)! From 55c631d1e19e0d0fcd98079ab4c15b94b525f1e2 Mon Sep 17 00:00:00 2001 From: pagezyhf Date: Fri, 12 Dec 2025 11:46:28 +0100 Subject: [PATCH 4/4] small --- _blog.yml | 2 +- deh-2025.md => dell-enterprise-security.md | 9 +++++---- 2 files changed, 6 insertions(+), 5 deletions(-) rename deh-2025.md => dell-enterprise-security.md (94%) diff --git a/_blog.yml b/_blog.yml index 63661b2416..76c762c4e4 100644 --- a/_blog.yml +++ b/_blog.yml @@ -4995,7 +4995,7 @@ - agents - local: dell-enterprise-security - date: Dec 11, 2025 + date: Dec 17, 2025 tags: - announcement - dell diff --git a/deh-2025.md b/dell-enterprise-security.md similarity index 94% rename from deh-2025.md rename to dell-enterprise-security.md index af2ba8b600..c55d274bca 100644 --- a/deh-2025.md +++ b/dell-enterprise-security.md @@ -1,14 +1,15 @@ --- -title: "Security and Performance for Dell On-Prem AI Builders" +title: "Security, Governance, and Performance for Dell On-Prem AI Builders" thumbnail: /blog/assets/dell-enterprise-hub/thumbnail.jpg authors: - user: pagezyhf - user: alvarobartt - user: juanjucm - user: jeffboudier + - user: balaattdell --- -# Security, Governance and Performance Updates for Dell On-Prem AI Builders +# Security, Governance and Performance for Dell On-Prem AI Builders ![Dell Enterprise Hub updates](/blog/assets/dell-enterprise-hub/thumbnail.jpg) @@ -50,7 +51,7 @@ Looking ahead, Dell Enterprise Hub will offer more opinionated choices defining Another major update in Dell Enterprise Hub is the introduction of container versioning, and the decoupling of containers and model weights, to improve AI developer experience and lifecycle management. Without Dell Enterprise Hub, enterprises need to continuously patch base images, upgrade inference engines, rotate models and archive older assets, often under strict compliance requirements. To make that easier, Dell Enterprise Hub now implements **decoupled container architecture with explicit versioning**. -Historically, many Dell Enterprise Hub containers shipped with the model weights within the container. This made the “first run” very straightforward, but it also led to large images and tighter coupling between the model and the runtime environment. From now on, new containers added to Dell Enterprise Hub are provided **without pre-downloaded weights, by default pulled from the Hugging Face Hub on runtime**. If required, it is still possible to download the model weights in advance and mount them into the container. +Historically, many Dell Enterprise Hub containers shipped with the model weights within the container. This made the “first run” very straightforward, but it also led to large images and tighter coupling between the model and the runtime environment. From now on, new containers added to Dell Enterprise Hub are provided **without pre-downloaded weights**, by default pulled from the Hugging Face Hub on runtime. If required, it is still possible to download the model weights in advance and mount them into the container. Additionnaly, instead of relying on a single `latest` tag for containers, Dell Enterprise Hub now exposes **versioned tags**. This means you can pin an exact container tag in production, test a newer container in staging, and move between them on your own schedule. The tags include the inference engine name and version to make debugging and experimentation more transparent. @@ -60,6 +61,6 @@ Additionnaly, instead of relying on a single `latest` tag for containers, Dell E These changes are another step towards making Dell Enterprise Hub the easiest way to run open models and applications on Dell platforms, fully on-premise and under your control. -We will continue to add support for new models, new modalities and new Dell platforms. Expect improved configurations built around real-world latency and throughput requirements, and a deeper integration between the Dell Enterprise Hub and Hugging Face Enterprise. +We will continue to add support for new models, new modalities and new Dell platforms. Expect improved configurations built around real-world latency and throughput requirements, and a deeper integration between the Dell Enterprise Hub and [Hugging Face Enterprise](https://huggingface.co/enterprise). To follow along, make sure to follow the [Dell Technologies organization](https://huggingface.co/DellTechnologies)!