Skip to content

Add native video clipping, FPS and agentic processing - #80

Merged
Mag1cFall merged 2 commits into
Mag1cFall:mainfrom
Delije4:feat/native-video-processing
Oct 28, 2026
Merged

Mag1cFall merged 2 commits into
Mag1cFall:mainfrom
Delije4:feat/native-video-processing

Conversation

@Delije4

@Delije4 Delije4 commented Oct 26, 2026 •

Copy link
Copy Markdown
Contributor

Changes

  • Add per-video clipping, fractional FPS and STATIC/AGENTIC processing to Gemini and Interactions inputs.
  • Preserve the controls through uploads, GenerateContent, CountTokens and Build. Keep MEDIA_PROCESSING steps, IDs and signatures intact in replies and follow-up history, separate from client-executed functions.
  • Expose agentic_video from the live model catalog. Reject invalid combinations and unsupported private Interaction model routes explicitly.
  • Update the protocol reference and both READMEs. No dependency, configuration or default-behavior changes.
  • Preserve processing history in stored continuations; normalize numeric offsets exactly, including exponent notation.

Verification

  • go test ./...: 162 test cases passed; focused race tests and go vet ./... passed.
  • Frontend lint, format check, production build and git diff --check passed.
  • Official Playground captures confirmed the wire fields. Earlier live gemini-3.8-flash checks passed on Playground and pinned Build: YouTube clipping/FPS, agentic navigation and follow-up history, including streaming. Build input was 1056/2883 tokens at 0.5/2 FPS, and 123 with clipping at 0.5 FPS.
  • Playground also passed distinct-section checks on a generated regular-frame video and Interactions step streaming.

@Delije4
Delije4 force-pushed the feat/native-video-processing branch from 828f35a to cb97af4 Compare October 28, 2026 00:22
- 删除视频参数的重复校验与本地预检,帧率、处理方式组合与模型能力交由上游判定
- 删除 Gemini 输入中已由键名归一化覆盖的 snake_case 字段与取值函数
- 合并 Playground 视频元数据与服务端处理步骤的编解码,Build 直接写出 Gemini API 字段
- 让 Responses 与 Interactions 续接历史保留代码执行、链接媒体与服务端处理步骤
- 把注释改为中文单行,测试精简为一个公开协议往返用例
@Mag1cFall
Mag1cFall force-pushed the feat/native-video-processing branch from cb97af4 to 0f41601 Compare October 28, 2026 09:32
@Mag1cFall
Mag1cFall merged commit 7cb5cc0 into Mag1cFall:main Oct 28, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants