Academy → Using HermesOfficial documentation · clear explanation

Segment Anything Model — SAM: zero-shot image segmentation via points, boxes, masks

Segment Anything Model — SAM: zero-shot image segmentation via points, boxes, masks

Developer15 minutes3 questions2026-08-09
The idea in one minute

Start with meaning, then move to detail.

This lesson explains Segment Anything Model — SAM: zero-shot image segmentation via points, boxes, masks as part of Hermes internals and extension points. You will learn what it does, when it matters, and the smallest safe test that proves it works.

If you are new

If you are new, do not memorize names. Focus on three questions: what problem does this solve, what access does it need, and how can you verify the result?

For hands-on use

For practice, inspect the first example, identify its effects, run it on test data, and compare the result with the source claim.

For specialists

For advanced readers, inspect Skill metadata, Reference: full SKILL.md, When to use SAM, then verify failure modes and version compatibility.

What do you need first?

Know Python, Git, and basic project structure before changing code.

What will you know?

A clear outcome before you read.

  • Understand Segment Anything Model — SAM: zero-shot image segmentation via points, boxes, masks without assumed prior knowledge.
  • Separate the source description from what still needs testing in your environment.
  • Read the first command and identify its inputs and outputs before copying it.
Lesson terms

Short definitions before the details.

Provider
The service that runs or provides access and authentication to a model.
Skill
An instruction bundle that teaches Hermes a repeatable workflow without necessarily adding an external service.
Official page description

SAM: zero-shot image segmentation via points, boxes, masks

Topic map

What does the source say, and in what order?

  1. 01
    Skill metadata

    Start here to understand the core idea or structure.

  2. 02
    Reference: full SKILL.md

    Read this after the foundation, then connect it to the previous step.

  3. 03
    When to use SAM

    Read this after the foundation, then connect it to the previous step.

  4. 04
    Quick start

    Read this after the foundation, then connect it to the previous step.

  5. 05
    Installation

    Read this after the foundation, then connect it to the previous step.

  6. 06
    Download checkpoints

    Read this after the foundation, then connect it to the previous step.

  7. 07
    Basic usage with SamPredictor

    Read this after the foundation, then connect it to the previous step.

  8. 08
    HuggingFace Transformers

    Read this after the foundation, then connect it to the previous step.

  9. 09
    Core concepts

    Read this after the foundation, then connect it to the previous step.

  10. 10
    Model architecture

    Finish here to verify the result and special cases.

Examples from the official page

Copy only after you understand the effect.

# From GitHub pip install git+https://github.com/facebookresearch/segment-anything.git # Optional dependencies pip install opencv-python pycocotools matplotlib # Or use HuggingFace transformers pip install transformers
# ViT-H (largest, most accurate) - 2.4GB wget https://dl.fbaipublicfiles.com/segment_anything/sam_vit_h_4b8939.pth # ViT-L (medium) - 1.2GB wget https://dl.fbaipublicfiles.com/segment_anything/sam_vit_l_0b3195.pth # ViT-B (smallest, fastest) - 375MB wget https://dl.fbaipublicfiles.com/segment_anything/sam_vit_b_01ec64.pth
### HuggingFace Transformers
Try it now

Read the first command and identify its inputs and outputs before copying it.

Match every command to your installed Hermes version, review the files and accounts it can reach, and use non-sensitive data for the first test. If this explanation differs from the source, the official source wins.

Knowledge check

Three decisions before completion.

1. What is the source of truth when “Segment Anything Model — SAM: zero-shot image segmentation via points, boxes, masks” changes?
2. What is the best way to apply this lesson?
3. What should happen before a step can modify files or an external account?