free-vision-skill

by niyongsheng

视觉与多模态github 检测到 manifest package.json#dsh 社区精选 收录于 08-16

基于 macOS Vision Framework 的全本地识图插件:`ocr_image`(文字提取,表格结构+坐标)与 `view_image`(场景/人脸/二维码);web 输入框可直接粘贴多张图片,图片永不离开你的 Mac。

Fully-local image understanding & OCR via macOS Vision Framework: `ocr_image` (text, table layout + coordinates) and `view_image` (scene, faces, QR) — paste multiple images into the web input box or pass path/URL/base64; images never leave your Mac.

安装

dsh plugin --profile web add github:niyongsheng/free-vision-skill

GitHub 源码安装:首次需按提示配置 allowBuilds 构建授权后重试

安装与环境配置指引、插件开发教程见 DSH 中文社区文档 ↗

安装即在你的机器上以你的权限运行第三方代码——它可读写文件、使用凭据、访问网络,DSH 的工具审批不会为插件代码加沙箱。「检测到 manifest」仅代表发现 dsh.bundle / dsh.plugin 清单,不构成兼容性或安全审查;安装前请审阅源码,不熟悉的插件先在不含密钥的环境试用。

README

目录

License Platform Framework Privacy

Fully-local image understanding (OCR / table extraction / description) via macOS Vision. Images never leave your Mac.

Install (DSH-Plugin)

dsh plugin add @niyongsheng/free-vision-skill

Then add to cordis.patch.yml:

- insert:
    - id: free-vision-skill
      name: '@niyongsheng/free-vision-skill'
      config:
        timeout: 120000

Tools

  • view_image — describe image content (scene, people, QR, composition)
  • ocr_image — extract text; layout=true for table structure + coordinates

Input: http(s) URL / base64 / local path.

Paste-to-path (Web UI)

Paste (⌘V) an image in the DSH web input box → its local absolute path is inserted. Loopback-only upload, magic-byte checked: PNG / JPEG / GIF / WebP / HEIC / HEIF.

Usage (Claude Code Skill)

swift scripts/ocr.swift image.png          # OCR
swift scripts/ocr.swift --layout image.png # table + coordinates
swift scripts/ocr.swift --describe image.png # describe image

Notes

  • Requires macOS 11+ & Xcode Command Line Tools
  • First run compiles ~5–10s, cached afterwards

License

MIT © 2026 Nico

原始 README: https://github.com/niyongsheng/free-vision-skill/blob/main/README.md ↗