RT @space_colonist: CoPE + RoPE + L + Ratio — mimi · mimi10v3

notes writing library about

May 30, 2024, 01:00 EDT

RT @space_colonist: CoPE + RoPE + L + Ratio

A table comparing different positional encoding (PE) methods and their parameter counts in millions. The table lists Absolute PE, RoPE, CoPE, and CoPE + RoPE with their respective parameter values.

♥0 likes↻0 repostscaptured Sep 30, 2026

Repost↗

← Previous note Next note →

© 2026 mimi · CC BY 4.0

llms.txt Privacy Terms & licensing