OTel Arrow pipeline

OTel Arrow 파이프라인

Group repeated telemetry attributes by column to improve transport efficiency.

···
html
<div class="demo"><div class="title">ROWS → COLUMNS</div><div class="scene"><div class="rows"><div>svc=A · 12ms</div><div>svc=A · 20ms</div><div>svc=A · 16ms</div></div><div class="arr">→</div><div class="cols"><div>svc: A × 3</div><div>ms: 12,20,16</div></div></div></div>
css
.demo{width:min(94vw,690px);height:min(88vh,320px);box-sizing:border-box;padding:clamp(9px,2.5vmin,18px);border:1px solid var(--line);border-radius:14px;background:var(--surface);color:var(--fg);font:600 clamp(12px,2.4vmin,16px)/1.25 var(--font-sans,"Pretendard Variable",Pretendard,-apple-system,BlinkMacSystemFont,sans-serif);display:flex;flex-direction:column;gap:clamp(7px,2vmin,14px);overflow:hidden}.title{color:var(--accent);font:700 clamp(12px,2.4vmin,16px)/1.2 var(--font-sans,"Pretendard Variable",Pretendard,-apple-system,BlinkMacSystemFont,sans-serif);letter-spacing:.04em}.scene{flex:1;min-height:0;position:relative;display:flex;align-items:center;justify-content:center;overflow:hidden}.scene{gap:6px}.rows,.cols{width:42%;display:grid;gap:6px;font:600 clamp(12px,2.4vmin,15px)/1 ui-monospace,monospace}.rows div,.cols div{border:1px solid var(--line);border-radius:5px;padding:7px 3px;text-align:center;white-space:nowrap;overflow:hidden}.rows div{animation:row 2.6s infinite}.rows div:nth-child(2){animation-delay:.2s}.rows div:nth-child(3){animation-delay:.4s}.cols div{border-color:var(--accent);background:color-mix(in srgb,var(--accent) 16%,var(--surface));animation:col 2.6s infinite}.arr{color:var(--accent);font-size:24px}@keyframes row{0%,15%,100%{border-color:var(--accent-2);background:color-mix(in srgb,var(--accent-2) 12%,var(--surface))}55%,85%{border-color:var(--line);background:var(--bg)}}@keyframes col{0%,30%,100%{border-color:var(--line);background:var(--bg)}55%,85%{border-color:var(--accent);background:color-mix(in srgb,var(--accent) 16%,var(--surface))}}

The OTel Arrow pipeline groups repeated telemetry fields into a column-oriented representation for more efficient transport. It is most promising when fields such as service names repeat across records.

The demo gathers repeated service fields from rows into one column. Savings depend on the data and pipeline configuration, so avoid assuming a fixed reduction.

When to use

Consider it when telemetry transport volume warrants pipeline efficiency work.

Open as page ↗