Curieux.JY
  • JungYeon Lee
  • Post
  • ๐Ÿ•ธ๏ธ Graph
  • Lecture
  • Note

On this page

  • ๐Ÿ” Ping Review
  • ๐Ÿ”” Ring Review
    • ํ•œ ์ค„๋กœ ์‹œ์ž‘ํ•˜๋ฉด
    • ๋ฐฐ๊ฒฝ: ์ด‰๊ฐ sim-to-real์—์„œ shear๊ฐ€ ๋น ์ ธ ์žˆ๋˜ ์ด์œ  (ยงIยทยงII)
    • ๋ฌธ์ œ ์ •์˜: marker ๋ณ€์œ„์žฅ (ยงIII ์„œ๋‘)
    • ๋ฐฉ๋ฒ• ์ƒ์„ธ 1: Dilation (ยงIII-A)
    • ๋ฐฉ๋ฒ• ์ƒ์„ธ 2: Shear, hydroelastic ํž˜ ์ถ”์  (ยงIII-B)
      • ํ‘œ๋ฉด์ ๊ณผ ์žฌ๊ท€ ๊ตฌ์กฐ
      • 1๋‹จ๊ณ„: ์ ‘์ด‰ ์•ˆ์—์„œ ์›€์ง์ธ ๋ชซ๋งŒ ๊ณ ๋ฅธ๋‹ค
      • 2๋‹จ๊ณ„: ๋ฒ•์„ ยท์ ‘์„ ์œผ๋กœ ๋‚˜๋ˆ  ํž˜์œผ๋กœ ๋ˆ„์ ํ•œ๋‹ค
      • 3๋‹จ๊ณ„: ์ ‘์ฐฉ ์—†์Œ, Coulomb ๋งˆ์ฐฐ, ๋ฆฌ์…‹
      • 4๋‹จ๊ณ„: ํž˜์ด ๊ฑธ๋ฆฌ๋Š” elastomer ์œ„์˜ ์œ„์น˜
      • 5๋‹จ๊ณ„: shear field
      • ๋ฌด์—‡์ด ๋ฌด์—‡์„ ํ‘œํ˜„ํ•˜๋Š”๊ฐ€
    • ๋ฐฉ๋ฒ• ์ƒ์„ธ 3: ๋ณด์ • (ยงIII-C, ยงIV-A, ๋ถ€๋ก)
    • ๋ฐฉ๋ฒ• ์ƒ์„ธ 4: Sim-to-real RL (ยงIII-D, ๋ถ€๋ก)
      • ์ •์‹ํ™”์™€ ํ•™์Šต ํŒŒ์ดํ”„๋ผ์ธ
      • ๊ด€์ธกยทํ–‰๋™ยท๋ณด์ƒ
      • ๋„คํŠธ์›Œํฌ์™€ ํ•˜์ดํผํŒŒ๋ผ๋ฏธํ„ฐ (๋ถ€๋ก B)
    • ์ง๊ด€: ์ •๊ทœํ™”๋œ shear์™€ ๊ธฐ์–ตํ•˜๋Š” shear
    • ์‹คํ—˜ 1: Shear ์ถฉ์‹ค๋„ (ยงIV-A, Table I, Fig. 5ยท6ยท13)
      • ์…‹์—…๊ณผ ๋ฒ ์ด์Šค๋ผ์ธ
      • ๊ฒฐ๊ณผ
    • ์‹คํ—˜ 2: Zero-shot sim-to-real RL (ยงIV-B, Table II)
      • ์‹ค์ œ ์…‹์—…
      • ๋น„๊ตํ•˜๋Š” ๋‹ค์„ฏ ์ •์ฑ…
      • ๊ฒฐ๊ณผ
      • ๊ณผ์ œ๋ณ„ ํ•ด์„ (์ €์ž ์„ค๋ช…)
      • ์„ฑ๊ณต๊นŒ์ง€ ๊ฑธ๋ฆฐ ์‹œ๊ฐ„ (๋ถ€๋ก Table IX)
      • Student ํ•™์Šต ๊ณก์„  (๋ถ€๋ก Fig. 9~12)
      • Contact penalty ablation
    • ์‹คํ—˜ 3: ๊ณ„์‚ฐ ์†๋„ (๋ถ€๋ก, Table XI)
    • ํ—ค๋“œ๋ผ์ธ ์ˆ˜์น˜ ๊ฒ€์‚ฐ
    • ์ €์ž๊ฐ€ ๋ฐํžŒ ํ•œ๊ณ„ (ยงV)
    • ๊ณต๊ฐœ ์ฝ”๋“œ์™€ ๋Œ€์กฐ (์ •์  ํ™•์ธ)
    • ๋น„ํŒ์ ์œผ๋กœ ๋ณด๋ฉด
      • ๊ฐ•์ 
      • ์•ฝ์ ยทํ•œ๊ณ„
    • ๊ด€๋ จ ์—ฐ๊ตฌ์™€์˜ ์ž๋ฆฌ ๋งค๊น€
    • ์š”์•ฝ
    • ์ด ๊ธ€์— ๋Œ€ํ•ด

๐Ÿ“ƒHydroShear ๋ฆฌ๋ทฐ

tactile
sim2real
rl
simulation
shear-force
HydroShear: Hydroelastic Shear Simulation for Tactile Sim-to-Real Reinforcement Learning
Published

November 20, 2026

  • Paper Link (arXiv:2603.00446v2)

  • Code Link

  • Project

  • An Dang*, Jayjun Lee*, Mustafa Mukadam, X. Alice Wu, Bernadette Bucher, Manikantan Nambi, Nima Fazeli (*๊ณต๋™ 1์ €์ž)

  • University of Michigan Robotics Department, Amazon Industrial Robotics Group, RSS 2026

  1. ๐Ÿ’ก vision-based ์ด‰๊ฐ ์„ผ์„œ ์‹œ๋ฎฌ๋ ˆ์ด์…˜์€ ์ด๋ฏธ์ง€ ๋ Œ๋”๋ง์€ ์ •๊ตํ•ด์กŒ์ง€๋งŒ shear(์ ‘์„  ๋ฐฉํ–ฅ marker ๋ณ€์œ„)๋Š” ์ˆœ๊ฐ„ ์นจํˆฌ๋Ÿ‰ยท์†๋„๋กœ ๊ทผ์‚ฌํ•˜๊ฑฐ๋‚˜ SE(2)๋กœ๋งŒ ๋‹ค๋ค„ ์™”๋‹ค. HydroShear๋Š” indenter ํ‘œ๋ฉด์ ์˜ ์ด๋™ ๊ฒฝ๋กœ๋ฅผ ๊ธฐ์–ตํ•˜๋Š” hydroelastic ํž˜ ์ถ”์ ์œผ๋กœ stick-slip, ๊ฒฝ๋กœ ์˜์กด ๋ˆ„์ , SE(3) ์ƒํ˜ธ์ž‘์šฉ์„ ํ•œ ์‹ ์•ˆ์—์„œ ์‹œ๋ฎฌ๋ ˆ์ด์…˜ํ•œ๋‹ค.
  2. โš™๏ธ ํ‘œ๋ฉด์ ๋งˆ๋‹ค elastomer SDF ์•ˆ์œผ๋กœ ๋“ค์–ด๊ฐ„ ๋ณ€์œ„๋งŒ ๊ณจ๋ผ ์„ ํ˜• ๊ฐ•์„ฑ์œผ๋กœ ํž˜์„ ๋ˆ„์ ํ•˜๊ณ , Coulomb cone์œผ๋กœ ์ž๋ฅด๊ณ , ์ ‘์ด‰์ด ๋Š๊ธฐ๋ฉด ๋ฆฌ์…‹ํ•œ๋‹ค. ๊ทธ ํž˜์„ Gaussian kernel๋กœ marker grid์— ํผ๋œจ๋ ค shear field๋ฅผ ๋งŒ๋“ค๊ณ , ํŒŒ๋ผ๋ฏธํ„ฐ 4๊ฐœ (\lambda_d,\lambda_s,K,\mu)๋ฅผ GelSight Mini ์‹ค์ธก์œผ๋กœ ํ•˜๋‚˜์”ฉ ๋ณด์ •ํ•œ ๋’ค Isaac Gym์—์„œ teacher-student(AACD) RL์„ ๋Œ๋ฆฐ๋‹ค.
  3. ๐ŸŽฏ sphere ์‹ค์ธก 40์ƒ˜ํ”Œ์—์„œ per-taxel RMSEยทcosine similarity ๋ชจ๋‘ TacSLยทFOTS๋ณด๋‹ค ์ข‹๊ณ (Table I), Franka Panda์˜ zero-shot sim-to-real 4๊ฐœ ๊ณผ์ œ์—์„œ 112/120(93%) ์œผ๋กœ TacSL Gray 41/120, TacSL Shear 70/120, ์ €์ž ๊ฐœ๋Ÿ‰ FOTS 73/120์„ ์•ž์„ ๋‹ค(Table II).

๐Ÿ” Ping Review

๐Ÿ” Ping โ€” A light tap on the surface. Get the gist in seconds.

์ด‰๊ฐ sim-to-real์˜ ๋ณ‘๋ชฉ์€ โ€œ๊ทธ๋ฆผ์ด ์–ผ๋งˆ๋‚˜ ์ง„์งœ ๊ฐ™์€๊ฐ€โ€๊ฐ€ ์•„๋‹ˆ๋ผ โ€œํž˜์ด ์–ผ๋งˆ๋‚˜ ์ง„์งœ์ฒ˜๋Ÿผ ์Œ“์ด๋Š”๊ฐ€โ€๋ผ๋Š” ๊ฒƒ์ด ์ด ๋…ผ๋ฌธ์˜ ์ถœ๋ฐœ์ ์ด๋‹ค. GelSight ๊ฐ™์€ vision-based ์„ผ์„œ์˜ RGB ์ด๋ฏธ์ง€๋Š” TaximยทTacSL ๋“ฑ์œผ๋กœ ๊ฝค ์‚ฌ์‹ค์ ์œผ๋กœ ๋ Œ๋”๋ง๋˜์ง€๋งŒ, ๊ทธ ์ด๋ฏธ์ง€๋Š” ์ฃผ๋กœ ์ ‘์ด‰ ๊ธฐํ•˜๋ฅผ ๋‹ด๋Š”๋‹ค. ๋ฌผ์ฒด์™€ ์„ผ์„œ ์‚ฌ์ด์— ์˜ค๊ฐ€๋Š” ํž˜์˜ ์ •๋ณด๋Š” marker์˜ ์ ‘์„  ๋ณ€์œ„, ์ฆ‰ tactile shear์— ์žˆ๋‹ค. ๊ธฐ์กด shear ์‹œ๋ฎฌ๋ ˆ์ด์…˜์€ FEM(์ •ํ™•ํ•˜์ง€๋งŒ RL์— ์“ฐ๊ธฐ์—” ๋А๋ฆผ), penalty ๊ธฐ๋ฐ˜(๋น ๋ฅด์ง€๋งŒ ์ˆœ๊ฐ„ ์นจํˆฌยท์†๋„๋งŒ ๋ด„), FOTS ๊ฐ™์€ marker ๋ชจ๋ธ(SE(2)๋งŒ ์ถ”์ ) ์ค‘ ํ•˜๋‚˜์˜€๊ณ , ์–ด๋А ๊ฒƒ๋„ โ€œํ•œ๋ฒˆ ๋ถ™์€ ์ ‘์ด‰์ ์ด ๋ฏธ๋„๋Ÿฌ์ง€๊ธฐ ์ „๊นŒ์ง€ ๋ณ€ํ˜•์ด ์Œ“์ด๋Š”โ€ ๊ฒฝ๋กœ ์˜์กด์„ฑ์„ ๋‹ค๋ฃจ์ง€ ๋ชปํ–ˆ๋‹ค.

HydroShear๋Š” indenter(๋ฌผ์ฒด) ํ‘œ๋ฉด์— ์ ์„ ๋ฟŒ๋ฆฌ๊ณ , ๊ฐ ์ ์ด elastomer ์•ˆ์œผ๋กœ ๋“ค์–ด๊ฐ„ ๋’ค ์›€์ง์ธ ๊ฒฝ๋กœ๋ฅผ ์‹œ๊ฐ„์— ๋”ฐ๋ผ ๋ˆ„์ ํ•ด ํž˜์œผ๋กœ ๋ฐ”๊พผ๋‹ค. ํž˜์ด ๋งˆ์ฐฐ ํ•œ๊ณ„๋ฅผ ๋„˜์œผ๋ฉด ์ž˜๋ผ์„œ slip์„, ์ ‘์ด‰์ด ๋Š๊ธฐ๋ฉด 0์œผ๋กœ ๋Œ๋ ค ๋ฆฌ์…‹์„ ํ‘œํ˜„ํ•œ๋‹ค. ๊ฒฐ๊ณผ ํž˜์€ ์ฒ˜์Œ ๋ถ™์€ ์œ„์น˜๋ฅผ ์ค‘์‹ฌ์œผ๋กœ Gaussian kernel๋กœ ํผ์ ธ ์ด์›ƒ marker๊นŒ์ง€ ๋Œ๊ณ  ๊ฐ€๋Š” tactile shadowing์„ ๋งŒ๋“ ๋‹ค.


Fig. 1. ๋„ค ๊ฐœ์˜ ์‹ค์ œ ๊ณผ์ œ(์•„๋ž˜)์™€ ๋Œ€์‘ํ•˜๋Š” Isaac Gym ํ™˜๊ฒฝ(์œ„). (a) Peg Insertion: ์† ์•ˆ ์ž์„ธ๊ฐ€ ๋ถˆํ™•์‹คํ•œ peg ์‚ฝ์ž…, (b) Bin Packing: ์ด์›ƒ cube๊ฐ€ ๋ชฉํ‘œ๋ฅผ ๊ฐ€๋ฆฌ๋Š” 4ร—4 bin์— cube ๋ฐ€์–ด ๋„ฃ๊ธฐ, (c) Book Shelving: ์ค‘๋ ฅ์ด ์‚ฝ์ž…์ถ•๊ณผ ์ง๊ตํ•˜๋Š” ์ธก๋ฉด ์‚ฝ์ž…, (d) Drawer Pulling: ์™ธ๋ž€์œผ๋กœ ๋ฏธ๋„๋Ÿฌ์ง€๋Š” ์†์žก์ด๋ฅผ gripper ํญ ์กฐ์ ˆ๋กœ ๋ถ™์žก๊ธฐ.

ํ•ต์‹ฌ ๋ฐฉ๋ฒ•๋ก :

marker ๋ณ€์œ„์žฅ \mathbf{M}_t๋ฅผ ๋ฒ•์„  ์••์ž…์— ์˜ํ•œ dilation \mathbf{M}^d_t์™€, ์ž์„ธ ์ด๋ ฅ {}^E\mathbf{X}^I_{0:t}์— ์˜์กดํ•˜๋Š” shear \mathbf{M}^s_t์˜ ํ•ฉ์œผ๋กœ ๋‘”๋‹ค. ํ•ต์‹ฌ์€ shear ์ชฝ์˜ ์žฌ๊ท€์  ํž˜ ์ถ”์ ์ด๋‹ค. indenter ํ‘œ๋ฉด์  j์˜ ์ ‘์ด‰ ๋‚ด ๋ณ€์œ„ \mathbf{d}_{j,t}๋ฅผ ๋ฒ•์„ ยท์ ‘์„ ์œผ๋กœ ๋‚˜๋ˆ  ๋ˆ„์ ํ•˜๊ณ , ์Œ์˜ ๋ฒ•์„ ๋ ฅ์€ 0์œผ๋กœ, ์ ‘์„ ๋ ฅ์€ Coulomb cone์œผ๋กœ ์ž๋ฅธ๋‹ค.

\mathbf{f}^{xy}_{j,t}=\tilde{\mathbf{f}}^{xy}_{j,t-1}+K A_j\,\mathbf{d}^{xy}_{j,t},\qquad \bar{\mathbf{f}}^{xy}_{j,t}=\min\Big\{1,\frac{\mu\,\bar f^n_{j,t}}{\lVert\mathbf{f}^{xy}_{j,t}\rVert_2}\Big\}\,\mathbf{f}^{xy}_{j,t}

์ฒซ ์‹์ด ๊ฒฝ๋กœ ์˜์กด ๋ˆ„์ (stick), ๋‘˜์งธ ์‹์˜ clipping์ด slip์ด๋‹ค. ์ด ํž˜์„ ์นจํˆฌ ๊นŠ์ด๋กœ ๊ฐ€์ค‘ํ•ด marker grid ์ขŒํ‘œ (x,y)์— Gaussian kernel๋กœ ๋ฟŒ๋ฆฌ๋ฉด shear field๊ฐ€ ๋œ๋‹ค.

\mathbf{M}^s_t(x,y)=\sum_{k\in K_t}-\phi_E(\mathbf{o}_{k,t})\cdot\big(-\tilde{\mathbf{f}}^{xy}_{k,t}\big)\cdot\exp\{-\lambda_s\lVert(x,y)-\hat{\mathbf{o}}^{xy}_{k,t}\rVert_2^2\}

์—ฌ๊ธฐ์„œ \phi_E๋Š” elastomer SDF, \hat{\mathbf{o}}_{k,t}๋Š” ๊ทธ ์ ์ด elastomer์— ์ฒ˜์Œ ๋‹ฟ์€(๋ฏธ๋„๋Ÿฌ์ง€๋ฉด ์ด๋™ํ•˜๋Š”) ์œ„์น˜๋‹ค. ๋ชจ๋ธ ์ „์ฒด์˜ ์ž์œ  ํŒŒ๋ผ๋ฏธํ„ฐ๋Š” dilation ๊ฐ์‡  \lambda_d, shear ๊ฐ์‡  \lambda_s, ์ ‘์„  ๊ฐ•์„ฑ K, ๋งˆ์ฐฐ๊ณ„์ˆ˜ \mu ๋„ค ๊ฐœ๋ฟ์ด๋‹ค.

์ฃผ์š” ๊ฒฐ๊ณผ:

  • Shear ์ถฉ์‹ค๋„ (Table I, 35 mm sphere, ์‹ค์ธก 40์ƒ˜ํ”Œ): per-taxel RMSE [px]๊ฐ€ dilation 1.000 / shear 1.719 / twist 2.021 / roll 1.576์œผ๋กœ ๋„ค ์œ ํ˜• ๋ชจ๋‘ ์ตœ์ €. cosine similarity๋Š” 0.976 / 0.951 / 0.974 / 0.904. FOTS๋Š” twistยทroll์—์„œ CS๊ฐ€ 0.683ยท0.561๋กœ ๋–จ์–ด์ง€๊ณ , TacSL์€ ๋ชจ๋“  ์œ ํ˜•์—์„œ CS 0.12~0.32์— ๋จธ๋ฌธ๋‹ค.
  • Zero-shot sim-to-real (Table II, ๊ณผ์ œ๋‹น 30ํšŒ): HydroShear 25/29/28/30 = 112/120(93.3%). TacSL Gray 41/120(34.2%), TacSL Shear 70/120(58.3%), ์› FOTS(์ €์ž ๋ณ‘๋ ฌํ™”) 41/120(34.2%), ์ €์ž ๊ฐœ๋Ÿ‰ FOTS(Reimpl.) 73/120(60.8%).
  • ์†๋„ (Table XI): 1024 ํ™˜๊ฒฝ ๊ธฐ์ค€ shear ๊ณ„์‚ฐ ์‹œ๊ฐ„์ด ์› FOTS 446.7 ms, FOTS (Reimpl.) 12.0 ms, HydroShear 103.7 ms. ์› FOTS๋ณด๋‹ค๋Š” ๋น ๋ฅด์ง€๋งŒ ์ €์ž๊ฐ€ ๋ณ‘๋ ฌํ™”ํ•œ FOTS๋ณด๋‹ค๋Š” ์•ฝ 3~9๋ฐฐ ๋А๋ฆฌ๋‹ค(ํ•„์ž ๊ณ„์‚ฐ).

๊ฒฐ๋ก :

์ด ๋…ผ๋ฌธ์˜ ๊ธฐ์—ฌ๋Š” shear๋ฅผ โ€œ์ง€๊ธˆ ์–ผ๋งˆ๋‚˜ ๋ˆŒ๋ ธ๋‚˜โ€๊ฐ€ ์•„๋‹ˆ๋ผ โ€œ๋ถ™์€ ๋’ค๋กœ ์–ผ๋งˆ๋‚˜ ๋Œ๋ ค์™”๋‚˜โ€๋กœ ์ •์˜ํ•œ ๋ฐ ์žˆ๋‹ค. ๊ทธ ์ •์˜ ํ•˜๋‚˜๋กœ stick-slip, hysteresis, SE(3) ํšŒ์ „ยทrolling์ด ๊ฐ™์€ ์‹์—์„œ ๋‚˜์˜ค๊ณ , ํŒŒ๋ผ๋ฏธํ„ฐ๋Š” 4๊ฐœ๋กœ ์ค„์–ด๋“ ๋‹ค. ์‹คํ—˜์€ ๊ทธ ์ฐจ์ด๊ฐ€ ์ •์ฑ… ์„ฑ๊ณต๋ฅ ๋กœ ์ด์–ด์ง„๋‹ค๋Š” ๊ฒƒ์„ ๋ณด์—ฌ ์ฃผ์ง€๋งŒ, ๊ณผ์ œ๋‹น 30ํšŒ๋ผ ๊ณผ์ œ๋ณ„ ์šฐ์œ„๋Š” ๋Œ€๋ถ€๋ถ„ ํ†ต๊ณ„์ ์œผ๋กœ ํฌ์ง€ ์•Š๊ณ , ํ—ค๋“œ๋ผ์ธ ๊ฒฉ์ฐจ์˜ ์ƒ๋‹น ๋ถ€๋ถ„์€ ๋ฒ ์ด์Šค๋ผ์ธ์ด ์‹œ๋ฎฌ๋ ˆ์ด์…˜ ์•ˆ์—์„œ๋ถ€ํ„ฐ ํ•™์Šต์— ์‹คํŒจํ•œ Drawer Pulling ํ•œ ๊ณผ์ œ์—์„œ ๋‚˜์˜จ๋‹ค. ์ •ํ™•ํ•œ shear๊ฐ€ sim-to-real์— ์ค‘์š”ํ•˜๋‹ค๋Š” ๋ฐฉํ–ฅ์„ฑ์€ ์„ค๋“๋ ฅ ์žˆ๊ฒŒ ์ œ์‹œ๋๊ณ , ์–ผ๋งˆ๋‚˜ ์ค‘์š”ํ•œ์ง€๋Š” ๋” ํฐ ํ‘œ๋ณธ์œผ๋กœ ๋‹ค์‹œ ์žฌ์•ผ ํ•œ๋‹ค.


๐Ÿ”” Ring Review

๐Ÿ”” Ring โ€” An idea that echoes. Grasp the core and its value.

ํ•œ ์ค„๋กœ ์‹œ์ž‘ํ•˜๋ฉด

์ ค ์œ„์— ์†๊ฐ€๋ฝ์„ ๋Œ€๊ณ  ์˜†์œผ๋กœ ์‚ด์ง ๋ฐ€๋ฉด, ์†๊ฐ€๋ฝ์ด ๋ฏธ๋„๋Ÿฌ์ง€๊ธฐ ์ „๊นŒ์ง€ ์ ค ํ‘œ๋ฉด์€ ์†๊ฐ€๋ฝ์— ๋ถ™์€ ์ฑ„ ํ•จ๊ป˜ ๋Œ๋ ค๊ฐ„๋‹ค. ๊ทธ ์ˆœ๊ฐ„ marker๊ฐ€ ์›€์ง์ธ ์–‘์€ ์ง€๊ธˆ ์†๊ฐ€๋ฝ์ด ์–ผ๋งˆ๋‚˜ ๊นŠ์ด ๋ˆŒ๋ ธ๋Š”์ง€๋‚˜ ์ง€๊ธˆ ์–ผ๋งˆ๋‚˜ ๋นจ๋ฆฌ ์›€์ง์ด๋Š”์ง€๊ฐ€ ์•„๋‹ˆ๋ผ, ์ฒ˜์Œ ๋ถ™์€ ๋’ค ์–ผ๋งˆ๋‚˜ ๋Œ๋ ค์™”๋Š”์ง€๋กœ ์ •ํ•ด์ง„๋‹ค. ๊ทธ๋ฆฌ๊ณ  ๋Œ๋ฆผ์ด ๋งˆ์ฐฐ ํ•œ๊ณ„๋ฅผ ๋„˜์œผ๋ฉด ๊ทธ๋•Œ๋ถ€ํ„ฐ๋Š” ๋” ์Œ“์ด์ง€ ์•Š๋Š”๋‹ค. HydroShear๋Š” ์ด ๋‹จ์ˆœํ•œ ๋ฌผ๋ฆฌ๋ฅผ indenter ํ‘œ๋ฉด์  ๋‹จ์œ„๋กœ ๊ธฐ๋กํ•˜๋Š” ์‹œ๋ฎฌ๋ ˆ์ดํ„ฐ๋‹ค. ์ด์ „ penalty ๊ธฐ๋ฐ˜ ๋ชจ๋ธ์€ ์ด โ€œ๊ธฐ์–ตโ€์ด ์—†์—ˆ๊ณ , FOTS๋Š” ๊ธฐ์–ต์€ ์žˆ์ง€๋งŒ ๋ฌผ์ฒด ์ค‘์‹ฌ ํ•˜๋‚˜์˜ SE(2) ์ด๋™๋งŒ ๊ธฐ์–ตํ–ˆ๋‹ค. ์ €์ž๋“ค์€ ์ด ์ฐจ์ด๊ฐ€ ์ •์ฑ…์˜ sim-to-real ์„ฑ๊ณต๋ฅ  ์ฐจ์ด๋กœ ๊ทธ๋Œ€๋กœ ์ด์–ด์ง„๋‹ค๊ณ  ์ฃผ์žฅํ•˜๊ณ , 4๊ฐœ ๊ณผ์ œ 120ํšŒ์˜ ์‹ค์ œ ์‹คํ—˜์œผ๋กœ ๊ทธ ์ฃผ์žฅ์„ ๋’ท๋ฐ›์นจํ•œ๋‹ค.

๋ฐฐ๊ฒฝ: ์ด‰๊ฐ sim-to-real์—์„œ shear๊ฐ€ ๋น ์ ธ ์žˆ๋˜ ์ด์œ  (ยงIยทยงII)

์ €์ž๋“ค์€ ์ด‰๊ฐ ์‹œ๋ฎฌ๋ ˆ์ด์…˜์˜ ํ˜„์žฌ๋ฅผ โ€œvisual fidelity๊ฐ€ dynamic fidelity๋ฅผ ์•ž์งˆ๋ €๋‹คโ€๋Š” ๋ง๋กœ ์š”์•ฝํ•œ๋‹ค. Taxim, TacSL, TacEx ๊ฐ™์€ ์‹œ๋ฎฌ๋ ˆ์ดํ„ฐ๋Š” GelSight๋ฅ˜ ์„ผ์„œ์˜ RGB ์ด๋ฏธ์ง€๋ฅผ ๊ทธ๋Ÿด๋“ฏํ•˜๊ฒŒ ๋งŒ๋“ค๊ณ , ์ผ๋ถ€ ๊ณผ์ œ์—์„œ๋Š” zero-shot ๋ฐฐํฌ๊นŒ์ง€ ์„ฑ๊ณตํ–ˆ๋‹ค. ํ•˜์ง€๋งŒ ์ด๋ฏธ์ง€๋Š” ์ฃผ๋กœ ์ ‘์ด‰ ๊ธฐํ•˜๋ฅผ ๋‹ด๊ณ , ์„ผ์„œ์™€ ๋ฌผ์ฒด ์‚ฌ์ด์˜ ํž˜ ์ƒํ˜ธ์ž‘์šฉ์€ marker์˜ ์ ‘์„  ๋ณ€์œ„์ธ tactile shear์— ๋‹ด๊ธด๋‹ค.

๊ธฐ์กด shear ์‹œ๋ฎฌ๋ ˆ์ด์…˜์˜ ์„ ํƒ์ง€๋Š” ์„ธ ๊ฐˆ๋ž˜์˜€๋‹ค.

๊ณ„์—ด ๋Œ€ํ‘œ ์žฅ์  ๋…ผ๋ฌธ์ด ์ง€์ ํ•œ ํ•œ๊ณ„
FEM Narang et al., DiffTactile ์ •ํ™•ํ•œ ๋ณ€ํ˜• ๋Œ€๊ทœ๋ชจ RL์— ์“ฐ๊ธฐ์—” ๊ณ„์‚ฐ์ด ๋„ˆ๋ฌด ๋น„์‹ธ๋‹ค
penalty ๊ธฐ๋ฐ˜ force field TacSL(Isaac Gym) ๋น ๋ฅด๊ณ  GPU ๋ณ‘๋ ฌ ์ˆœ๊ฐ„ ์นจํˆฌยท์ƒ๋Œ€ ์†๋„๋งŒ ๋ณด๊ณ  shear๋ฅผ ๊ทผ์‚ฌํ•ด tactile shadowing๊ณผ ๊ฒฝ๋กœ ์˜์กด ๋ณ€ํ˜•์„ ๋†“์นœ๋‹ค. ๊ทธ๋ž˜์„œ ์ •์ฑ… ํ•™์Šต ๋•Œ per-taxel๋กœ unit vector๋กœ ์ •๊ทœํ™”ํ•ด ํฌ๊ธฐ ์ •๋ณด๋ฅผ ๋ฒ„๋ฆฐ๋‹ค
marker ๋ณ€์œ„ ๋ชจ๋ธ FOTS tactile shadowing์„ kernel๋กœ ๋ชจ๋ธ๋ง, sim-to-real ์‚ฌ๋ก€ ์žˆ์Œ ๋ฌผ์ฒด ์šด๋™์„ SE(2)๋กœ๋งŒ ์ถ”์ ํ•ด rolling ๊ฐ™์€ SE(3) ์šด๋™์˜ shear๋ฅผ ํ‘œํ˜„ํ•˜์ง€ ๋ชปํ•œ๋‹ค. ์› ๊ตฌํ˜„์€ GPU ๋ณ‘๋ ฌํ™”๊ฐ€ ์•ˆ ๋ผ ์žˆ๋‹ค

์—ฌ๊ธฐ์„œ tactile shadowing์€ ํ•œ ์ ‘์ด‰ ์˜์—ญ์—์„œ ์ƒ๊ธด ๋ณ€ํ˜•์ด ์ด์›ƒ ์˜์—ญ์˜ shear ์ •๋ณด๋ฅผ ๊ฐ€๋ฆฌ๊ฑฐ๋‚˜ ์™œ๊ณกํ•˜๋Š” ํšจ๊ณผ๋‹ค. ์‹ค์ œ elastomer๋Š” ์—ฐ์†์ฒด๋ผ ํ•œ ์ ์„ ๋Œ๋ฉด ์ฃผ๋ณ€ marker๋„ ํ•จ๊ป˜ ๋Œ๋ ค๊ฐ€๋Š”๋ฐ, penalty ๊ธฐ๋ฐ˜ ๋ชจ๋ธ์€ ๊ฐ grid ์ ์„ ๋…๋ฆฝ์ ์œผ๋กœ ๊ณ„์‚ฐํ•˜๋ฏ€๋กœ ์ด ํšจ๊ณผ๊ฐ€ ์—†๋‹ค. ์ €์ž๋“ค์ด TacSL์˜ ์ •๊ทœํ™” ๊ด€ํ–‰์„ โ€œshadowing์ด ์—†๋Š” ์‹œ๋ฎฌ๋ ˆ์ด์…˜๊ณผ ์‹ค์ธก์˜ ์ฐจ์ด๋ฅผ ๋ฉ”์šฐ๋ ค๋Š” ์šฐํšŒโ€๋กœ ํ•ด์„ํ•˜๋Š” ์ด์œ ๊ฐ€ ์—ฌ๊ธฐ ์žˆ๋‹ค.

์ด‰๊ฐ ์‹œ๋ฎฌ๋ ˆ์ดํ„ฐ ์ง€ํ˜• ์ „๋ฐ˜์€ ์ด ๋ธ”๋กœ๊ทธ์˜ TACTO, TacEx(FOTS๋ฅผ marker ์‹œ๋ฎฌ๋ ˆ์ด์…˜์— ์‚ฌ์šฉ), FEM ๊ณ„์—ด TaCauchy ๋ฆฌ๋ทฐ์—์„œ ๋‹ค๋ค˜๋‹ค. HydroShear๋Š” ๊ทธ์ค‘ โ€œrigid-body ์‹œ๋ฎฌ๋ ˆ์ด์…˜ ์œ„์—์„œ ํ›„์ฒ˜๋ฆฌ๋กœ ์ด‰๊ฐ์„ ๊ณ„์‚ฐํ•˜๋Š” ๋น ๋ฅธ ๊ณ„์—ดโ€์— ์†ํ•˜๋ฉด์„œ FEM์ด ์ฃผ๋Š” ๊ฒฝ๋กœ ์˜์กด์„ฑ ์ผ๋ถ€๋ฅผ ๊ฐ€์ ธ์˜ค๋ ค๋Š” ์‹œ๋„๋‹ค.

๋ฌธ์ œ ์ •์˜: marker ๋ณ€์œ„์žฅ (ยงIII ์„œ๋‘)

elastomer ์œ„์˜ tactile grid query point(= marker ์œ„์น˜) \{\mathbf{p}_i\}_{i=1}^N, \mathbf{p}_i\in\mathbb{R}^3์— ๋Œ€ํ•ด 2D shear ๋ฒกํ„ฐ \mathbf{s}_i=(d_x,d_y)๋ฅผ ๊ตฌํ•˜๋Š” ๊ฒƒ์ด ๋ชฉํ‘œ๋‹ค. ์ €์ž๋“ค์€ ์ด๋ฅผ query ์ขŒํ‘œ์™€ elastomer ์ขŒํ‘œ๊ณ„์—์„œ ๋ณธ indenter ์ž์„ธ ์ด๋ ฅ์„ ๋ฐ›๋Š” ์‚ฌ์ƒ์œผ๋กœ ์“ด๋‹ค.

\mathbf{M}:\big((x,y),\{{}^E\mathbf{X}^I_t\}_{t=0}^T\big)\rightarrow\mathbf{s}_i, \qquad \mathbf{M}_t\big((x,y),{}^E\mathbf{X}^I_{0:t}\big)=\mathbf{M}^d_t\big((x,y)\big)+\mathbf{M}^s_t\big((x,y),{}^E\mathbf{X}^I_{0:t}\big)

dilation \mathbf{M}^d_t๋Š” ์„ผ์„œ ๋ฒ•์„  ๋ฐฉํ–ฅ ์นจํˆฌ์—์„œ ์ƒ๊ธฐ๊ณ  ํ˜„์žฌ ์ƒํƒœ๋งŒ์œผ๋กœ ์ •ํ•ด์ง„๋‹ค. shear \mathbf{M}^s_t๋Š” ์ ‘์ด‰ ์ค‘ ์ ‘์„  ์ด๋™์ด๋‚˜ SO(3) ํšŒ์ „์—์„œ ์ƒ๊ธฐ๋ฉฐ ์ž์„ธ ์ด๋ ฅ์— ์˜์กดํ•œ๋‹ค. ์ •์˜ ๋‹จ๊ณ„์—์„œ ์ด๋ฏธ shear๋ฅผ ์ด๋ ฅ์˜ ํ•จ์ˆ˜๋กœ ๋‘” ๊ฒƒ์ด ์ด ๋…ผ๋ฌธ์˜ ๋ชจ๋“  ์„ค๊ณ„๋ฅผ ๊ฒฐ์ •ํ•œ๋‹ค. ์ €์ž๋“ค์ด HydroShear๋ฅผ โ€œnon-holonomicโ€ hydroelastic ๋ชจ๋ธ์ด๋ผ๊ณ  ๋ถ€๋ฅด๋Š” ๊ฒƒ๋„ ์ด ๋œป์ด๋‹ค. ์ƒํƒœ๊ฐ€ ํ˜„์žฌ ์ž์„ธ๋งŒ์œผ๋กœ ์ •ํ•ด์ง€์ง€ ์•Š๊ณ  ๊ฒฝ๋กœ์— ๋”ฐ๋ผ ๋‹ฌ๋ผ์ง„๋‹ค๋Š” ์˜๋ฏธ๋กœ ์“ด ํ‘œํ˜„์ด๋‹ค.


Fig. 3. HydroShear ํŒŒ์ดํ”„๋ผ์ธ. (a) indenter ํ‘œ๋ฉด์  \{\mathbf{o}_{j,t}\}์™€ indenter SDF, (b) elastomer SDF์™€ tactile grid query point \{\mathbf{p}_i\}, (c) \phi_I(\mathbf{p}_i)<0์ธ grid ์ (๋…ธ๋ž€์ƒ‰)์œผ๋กœ ๊ณ„์‚ฐํ•˜๋Š” dilation, (d) elastomer ์•ˆ์œผ๋กœ ๋“ค์–ด๊ฐ„ ํ‘œ๋ฉด์ (\phi_E(\mathbf{o}_t)<0)์˜ 3D ๋ณ€์œ„ -\hat{\mathbf{f}}_{j,t}(๋นจ๊ฐ„ ํ™”์‚ดํ‘œ)๋กœ ๊ณ„์‚ฐํ•˜๋Š” shear, (e) ๋‘ ์žฅ์„ ๋”ํ•œ ์ „์ฒด marker ๋ณ€์œ„์žฅ \mathbf{M}_t.

๋ฐฉ๋ฒ• ์ƒ์„ธ 1: Dilation (ยงIII-A)

dilation์€ FOTS์™€ ๊ฐ™์€ ์‹์„ ์“ด๋‹ค. indenter SDF \phi_I๊ฐ€ ์Œ์ˆ˜์ธ grid ์ ์„ ์ ‘์ด‰์  ์ง‘ํ•ฉ C=\{c_i\mid\phi_I(\mathbf{p}_{c_i})<0\}์œผ๋กœ ๋ชจ์œผ๊ณ , ๊ฐ ์ ‘์ด‰์ ์ด query ์ขŒํ‘œ๋ฅผ ๋ฐ”๊นฅ์œผ๋กœ ๋ฐ€์–ด๋‚ด๋Š” ํšจ๊ณผ๋ฅผ ์นจํˆฌ ๊นŠ์ด๋กœ ๊ฐ€์ค‘ํ•ด ํ•ฉํ•œ๋‹ค.

\mathbf{M}^d_t=\sum_{i=1}^{|C|}-\phi_I(\mathbf{p}_{c_i})\cdot\mathbf{v}_{c_i}\cdot\exp\{-\lambda_d\lVert\mathbf{v}_{c_i}\rVert_2^2\}, \qquad \mathbf{v}_{c_i}=\begin{bmatrix}x\\y\end{bmatrix}-\mathbf{p}^{xy}_{c_i}

  • -\phi_I(\mathbf{p}_{c_i})>0: ๊ทธ grid ์ ์ด indenter ์•ˆ์œผ๋กœ ๋“ค์–ด๊ฐ„ ๊นŠ์ด. ๊นŠ๊ฒŒ ๋ˆŒ๋ฆฐ ๊ณณ์ผ์ˆ˜๋ก ํฌ๊ฒŒ ๋ฏผ๋‹ค.
  • \mathbf{v}_{c_i}: ์ ‘์ด‰์ ์—์„œ query ์ขŒํ‘œ๋กœ ํ–ฅํ•˜๋Š” ๋ฒกํ„ฐ. dilation์ด ๋ฐฉ์‚ฌํ˜•์œผ๋กœ ๋ฐ”๊นฅ์„ ํ–ฅํ•˜๋Š” ์ด์œ ๋‹ค.
  • \exp\{-\lambda_d\lVert\mathbf{v}\rVert^2\}: ๊ฑฐ๋ฆฌ์— ๋”ฐ๋ฅธ ๊ฐ์‡ . ์ ‘์ด‰ ๋ฐ– marker๋„ ๋Œ๋ ค ๋‚˜๊ฐ€๋Š” shadowing์„ ์ด kernel ํ•˜๋‚˜๋กœ ํ‘œํ˜„ํ•œ๋‹ค.

์ด ํ•ญ์€ FOTS์™€ ๊ณต์œ ๋˜๋ฏ€๋กœ(๋ถ€๋ก A๊ฐ€ ๋ช…์‹œ) ๋‘ ๋ฐฉ๋ฒ•์˜ ์ฐจ์ด๋Š” ์ „๋ถ€ shear ์ชฝ์—์„œ ๋‚˜์˜จ๋‹ค. Table I์˜ dilation ์—ด์—์„œ ๋‘ ๋ฐฉ๋ฒ•์˜ CS๊ฐ€ 0.976์œผ๋กœ ๊ฐ™์€ ๊ฒƒ๋„ ์ด ๊ตฌ์กฐ์™€ ๋งž๋Š”๋‹ค.

๋ฐฉ๋ฒ• ์ƒ์„ธ 2: Shear, hydroelastic ํž˜ ์ถ”์  (ยงIII-B)

ํ‘œ๋ฉด์ ๊ณผ ์žฌ๊ท€ ๊ตฌ์กฐ

indenter ํ‘œ๋ฉด์— M๊ฐœ์˜ ์  \bar{\mathbf{o}}_j(indenter ์ขŒํ‘œ๊ณ„)๋ฅผ ์ƒ˜ํ”Œ๋งํ•˜๊ณ , ๋งค ์‹œ์  ์ž์„ธ๋กœ ์˜ฎ๊ฒจ \mathbf{o}_{j,t}={}^E\mathbf{X}^I_t\,\bar{\mathbf{o}}_j๋ฅผ ์–ป๋Š”๋‹ค. ํ‘œ๋ฉด์  ์ƒ˜ํ”Œ๋ง์€ ์ง€๋ฆ„ 1.5 mm surfel๋กœ ํ•˜๋Š”๋ฐ, GelSight Mini์˜ marker ๊ฐ„๊ฒฉ ์•ฝ 2 mm์— ๋งž์ถ˜ ๊ฐ’์ด๋‹ค(๋ถ€๋ก Point Cloud Density). ๊ฐ ์ ์˜ ์ ‘์ด‰๋ ฅ \tilde{\mathbf{f}}_{j,t}๋Š” ์ง์ „ ํž˜๊ณผ ๋‘ ์‹œ์ ์˜ ์ž์„ธ๋กœ ์ •ํ•ด์ง€๋Š” ์žฌ๊ท€์‹์œผ๋กœ ์ถ”์ ํ•œ๋‹ค.

\tilde{\mathbf{f}}_{j,t}=F\big(\tilde{\mathbf{f}}_{j,t-1},{}^E\mathbf{X}^I_t,{}^E\mathbf{X}^I_{t-1},\bar{\mathbf{o}}_j;\,E,K,A_j,\mu\big),\qquad \tilde{\mathbf{f}}_{j,0}=0

E๋Š” indenter ๋ฒ•์„  ๋ฐฉํ–ฅ ๊ฐ•์„ฑ, K๋Š” ์„ผ์„œ ๋ฒ•์„ ์— ์ ‘์„ ์ธ ๋ฐฉํ–ฅ์˜ ๊ฐ•์„ฑ, A_j๋Š” ํ‘œ๋ฉด์ ์ด ๋Œ€ํ‘œํ•˜๋Š” ๋ฉด์ ์ด๋‹ค. ๋…ผ๋ฌธ์€ ์ด ๋ชจ๋ธ์ด hydrostatic pressure field contact model์„ ํ™•์žฅํ•œ ๊ฒƒ์ด๋ผ ์†Œ๊ฐœํ•˜์ง€๋งŒ, ์••๋ ฅ์žฅ ์ž์ฒด๋ฅผ ์‹์œผ๋กœ ์“ฐ์ง€๋Š” ์•Š๋Š”๋‹ค. ์‹ค์ œ๋กœ ์“ฐ์ด๋Š” ๊ฒƒ์€ โ€œSDF ์นจํˆฌ๋กœ ์ ‘์ด‰ ์—ฌ๋ถ€๋ฅผ ์ •ํ•˜๊ณ , ์นจํˆฌ ๋ณ€์œ„๋ฅผ ์„ ํ˜• ๊ฐ•์„ฑ์œผ๋กœ ํž˜์— ์˜ฎ๊ธฐ๋Š”โ€ ์  ๋‹จ์œ„ ๊ทผ์‚ฌ๋‹ค. hydroelastic contact ์ž์ฒด์˜ ์••๋ ฅ์žฅ ์ •์‹ํ™”๊ฐ€ ๊ถ๊ธˆํ•˜๋ฉด GPU-Accelerated Hydroelastic Contact ๋ฆฌ๋ทฐ๊ฐ€ ๊ทธ ๋ฐฐ๊ฒฝ์„ ๋‹ค๋ฃฌ๋‹ค.

1๋‹จ๊ณ„: ์ ‘์ด‰ ์•ˆ์—์„œ ์›€์ง์ธ ๋ชซ๋งŒ ๊ณ ๋ฅธ๋‹ค

ํ•œ ์Šคํ… ๋™์•ˆ ํ‘œ๋ฉด์ ์ด \mathbf{o}_{j,t-1}\to\mathbf{o}_{j,t}๋กœ ์›€์ง์˜€์„ ๋•Œ, ๊ทธ ๋ณ€์œ„ ์ค‘ elastomer ์•ˆ์—์„œ ์ผ์–ด๋‚œ ๋ถ€๋ถ„๋งŒ ํž˜์œผ๋กœ ๋ฐ”๊ฟ”์•ผ ํ•œ๋‹ค. ์ €์ž๋“ค์€ elastomer SDF \phi_E์˜ ๋ณ€ํ™”๋Ÿ‰ ์ค‘ ์Œ์ˆ˜ ์˜์—ญ์— ํ•ด๋‹นํ•˜๋Š” ๋น„์œจ \alpha_{j,t}๋กœ ์ด๋ฅผ ๊ทผ์‚ฌํ•œ๋‹ค.

\alpha_{j,t}=\frac{\mathrm{ReLU}\big(-\phi_E(\mathbf{o}_{j,t})\big)-\mathrm{ReLU}\big(-\phi_E(\mathbf{o}_{j,t-1})\big)}{\phi_E(\mathbf{o}_{j,t})-\phi_E(\mathbf{o}_{j,t-1})}, \qquad \mathbf{d}_{j,t}=\alpha_{j,t}\big(\mathbf{o}_{j,t}-\mathbf{o}_{j,t-1}\big)

ReLU ํ•˜๋‚˜๋กœ ์„ธ ๊ฒฝ์šฐ๊ฐ€ ์ •๋ฆฌ๋œ๋‹ค. ๋‘ ์‹œ์  ๋ชจ๋‘ elastomer ์•ˆ(\phi_E<0)์ด๋ฉด \alpha=1๋กœ ๋ณ€์œ„ ์ „์ฒด๊ฐ€ ์ ‘์ด‰ ์ค‘์ด๊ณ , ๋‘˜ ๋‹ค ๋ฐ–์ด๋ฉด \alpha=0, ๋ถ€ํ˜ธ๊ฐ€ ๋‹ค๋ฅด๋ฉด(๋ง‰ ๋“ค์–ด์˜ค๊ฑฐ๋‚˜ ๋ง‰ ๋‚˜๊ฐ€๋Š” ์ค‘) 0<\alpha<1๋กœ ๊ฒฝ๊ณ„๋ฅผ ์ง€๋‚œ ๋น„์œจ๋งŒ ์„ผ๋‹ค. ๋…ผ๋ฌธ ์‹์—๋Š” \alpha^d_{j,t}๋กœ ์œ„์ฒจ์ž d๊ฐ€ ๋ถ™์–ด ์žˆ๋Š”๋ฐ, ๋ฐ”๋กœ ์œ„ ์ •์˜๋Š” \alpha_{j,t}๋ฟ์ด๋ผ ์˜ค๊ธฐ๋กœ ๋ณด์ธ๋‹ค.

2๋‹จ๊ณ„: ๋ฒ•์„ ยท์ ‘์„ ์œผ๋กœ ๋‚˜๋ˆ  ํž˜์œผ๋กœ ๋ˆ„์ ํ•œ๋‹ค

\mathbf{d}_{j,t}๋ฅผ indenter ๋ฒ•์„  \hat{\mathbf{n}}_j์— ์‚ฌ์˜ํ•ด ๋ฒ•์„  ์„ฑ๋ถ„ d^n_{j,t}=\langle\mathbf{d}_{j,t},\hat{\mathbf{n}}_j\rangle์„, ๋‚˜๋จธ์ง€๋ฅผ ์ ‘์„  ์„ฑ๋ถ„ \mathbf{d}^{xy}_{j,t}=\mathbf{d}_{j,t}-d^n_{j,t}\hat{\mathbf{n}}_j๋กœ ๋‘”๋‹ค. ๊ฐ๊ฐ์„ ์„ ํ˜• ๊ฐ•์„ฑ์œผ๋กœ ์ง์ „ ํž˜์— ๋”ํ•œ๋‹ค.

f^n_{j,t}=\tilde f^n_{j,t-1}+E A_j\,d^n_{j,t},\qquad \mathbf{f}^{xy}_{j,t}=\tilde{\mathbf{f}}^{xy}_{j,t-1}+K A_j\,\mathbf{d}^{xy}_{j,t}

์ด ๋ง์…ˆ์ด ๊ฒฝ๋กœ ์˜์กด์„ฑ์˜ ์ „๋ถ€๋‹ค. ๊ฐ™์€ ์œ„์น˜์— ์žˆ์–ด๋„ ๊ฑฐ๊ธฐ๊นŒ์ง€ ์–ด๋–ป๊ฒŒ ์™”๋А๋ƒ์— ๋”ฐ๋ผ ๋ˆ„์ ๋œ ์ ‘์„ ๋ ฅ์ด ๋‹ค๋ฅด๊ณ , ๋˜๋Œ์•„์˜ค๋ฉด ๋ฐ˜๋Œ€ ๋ฐฉํ–ฅ ๋ณ€์œ„๊ฐ€ ๋”ํ•ด์ ธ ์ค„์–ด๋“ ๋‹ค. ์ €์ž๋“ค์ด hysteresis๋ผ๊ณ  ๋ถ€๋ฅด๋Š” ํ˜„์ƒ์ด ์ด ๋ˆ„์ ์—์„œ ๋‚˜์˜จ๋‹ค.

3๋‹จ๊ณ„: ์ ‘์ฐฉ ์—†์Œ, Coulomb ๋งˆ์ฐฐ, ๋ฆฌ์…‹

\bar f^n_{j,t}=\mathrm{ReLU}(f^n_{j,t}),\qquad \bar{\mathbf{f}}^{xy}_{j,t}=\min\Big\{1,\frac{\mu\,\bar f^n_{j,t}}{\lVert\mathbf{f}^{xy}_{j,t}\rVert_2}\Big\}\mathbf{f}^{xy}_{j,t},\qquad \tilde{\mathbf{f}}_{j,t}=H\big(-\phi_E(\mathbf{o}_{j,t})\big)\cdot\big(\bar f^n_{j,t}\hat{\mathbf{n}}_j+\bar{\mathbf{f}}^{xy}_{j,t}\big)

  • ๋ฒ•์„ ๋ ฅ์€ ์Œ์ˆ˜๊ฐ€ ๋  ์ˆ˜ ์—†๋‹ค(elastomer๊ฐ€ ๋ฌผ์ฒด๋ฅผ ๋‹น๊ธฐ์ง€ ์•Š๋Š”๋‹ค).
  • ์ ‘์„ ๋ ฅ ํฌ๊ธฐ๊ฐ€ \mu\bar f^n์„ ๋„˜์œผ๋ฉด ๋ฐฉํ–ฅ์€ ์œ ์ง€ํ•œ ์ฑ„ ํฌ๊ธฐ๋งŒ ์ž˜๋ฆฐ๋‹ค. ์ž˜๋ฆฌ๋Š” ์ˆœ๊ฐ„์ด slip์ด๊ณ , ๊ทธ ๋’ค๋กœ๋Š” ๋” ๋Œ์–ด๋„ ์ ‘์„ ๋ ฅ์ด ๋Š˜์ง€ ์•Š๋Š”๋‹ค. stick-slip ํŒ์ •์€ ๋ณ„๋„ ๋…ผ๋ฆฌ ์—†์ด ์ด clipping ํ•˜๋‚˜๋กœ ์ด๋ค„์ง„๋‹ค.
  • Heaviside H๋กœ elastomer ๋ฐ–์œผ๋กœ ๋‚˜๊ฐ„ ์ ์˜ ํž˜์„ 0์œผ๋กœ ๋ฆฌ์…‹ํ•œ๋‹ค. ๋‹ค์‹œ ๋‹ฟ์œผ๋ฉด ์ฒ˜์Œ๋ถ€ํ„ฐ ์Œ“๋Š”๋‹ค.

4๋‹จ๊ณ„: ํž˜์ด ๊ฑธ๋ฆฌ๋Š” elastomer ์œ„์˜ ์œ„์น˜

ํž˜์„ marker grid์— ๋ฟŒ๋ฆฌ๋ ค๋ฉด ๊ฐ ํž˜์ด elastomer์˜ ์–ด๋””์— ๊ฑธ๋ฆฌ๋Š”์ง€ ์•Œ์•„์•ผ ํ•œ๋‹ค. stick ์ƒํƒœ๋ฉด ๊ทธ ์œ„์น˜๋Š” ์ฒ˜์Œ ๋‹ฟ์€ ๊ณณ์—์„œ ๋ณ€ํ•˜์ง€ ์•Š๊ณ , slip ์ƒํƒœ๋ฉด ๋ฏธ๋„๋Ÿฌ์ง„ ๋งŒํผ ์˜ฎ๊ฒจ ๊ฐ„๋‹ค. ์ €์ž๋“ค์€ ์ด๋ฅผ ํ‘œ๋ฉด์ ์— ๋”ํ•˜๋Š” ๋ณ€์œ„ \hat{\mathbf{f}}_{j,t}๋กœ ํ‘œํ˜„ํ•˜๊ณ (\hat{\mathbf{o}}_{j,t}=\mathbf{o}_{j,t}+\hat{\mathbf{f}}_{j,t}), ๊ฐ™์€ ์ถ”์ ๊ธฐ F๋ฅผ ๊ฐ•์„ฑยท๋ฉด์ ์„ 1๋กœ ๋‘” ์ฑ„ ๋‹ค์‹œ ๋Œ๋ ค ์ด ๋ณ€์œ„๋ฅผ ์–ป๋Š”๋‹ค.

\hat{\mathbf{f}}_{j,t}=F\big(\hat{\mathbf{f}}_{j,t-1},{}^E\mathbf{X}^I_t,{}^E\mathbf{X}^I_{t-1},\bar{\mathbf{o}}_j;\,1,1,1,\hat\mu\big)

์ถ”์ ๊ธฐ๋ฅผ ๋‘ ๋ฒˆ ๋Œ๋ฆด ํ•„์š”๋Š” ์—†๋‹ค๋Š” ๊ฒƒ์ด ์ €์ž๋“ค์˜ ๊ด€์ฐฐ์ด๋‹ค. E=K, \mu=\hat\mu, A_j=A(ํ‘œ๋ฉด์  ๋ฉด์  ๊ท ์ผ)๋ฅผ ๊ฐ€์ •ํ•˜๋ฉด ๋‘ ์ถ”์ ๊ธฐ๋Š” ์ƒ์ˆ˜๋ฐฐ ๊ด€๊ณ„๊ฐ€ ๋˜์–ด \tilde{\mathbf{f}}_{j,t}=KA\cdot\hat{\mathbf{f}}_{j,t}๋กœ ํž˜์„ ๋ณ€์œ„์—์„œ ๋ฐ”๋กœ ์–ป๋Š”๋‹ค. ๋ฒ•์„ ยท์ ‘์„  ๊ฐ•์„ฑ์ด ๊ฐ™๋‹ค๋Š” ๊ฐ€์ •์€ ๊ฝค ๊ฐ•ํ•œ๋ฐ, ๊ทธ ๋Œ€๊ฐ€๋กœ E๊ฐ€ ๋”ฐ๋กœ ๋ณด์ •ํ•  ํŒŒ๋ผ๋ฏธํ„ฐ์—์„œ ๋น ์ง„๋‹ค.

5๋‹จ๊ณ„: shear field

์ ‘์ด‰ ์ค‘์ธ ํ‘œ๋ฉด์  ์ง‘ํ•ฉ K_t=\{k_i\mid\phi_E(\mathbf{o}_{k_i,t})<0\}์— ๋Œ€ํ•ด(๊ฐ•์„ฑ K์™€ ๊ฐ™์€ ๊ธ€์ž์ง€๋งŒ ๋‹ค๋ฅธ ๋œป์ด๋‹ค), ๊ฐ ์ ์˜ ์ ‘์„ ๋ ฅ์„ ์นจํˆฌ ๊นŠ์ด๋กœ ๊ฐ€์ค‘ํ•˜๊ณ  ํž˜์ด ๊ฑธ๋ฆฐ ์œ„์น˜ \hat{\mathbf{o}}^{xy}์—์„œ Gaussian์œผ๋กœ ๊ฐ์‡ ์‹œ์ผœ ํ•ฉํ•œ๋‹ค.

\mathbf{M}^s_t=\sum_{i=1}^{|K_t|}-\phi_E(\mathbf{o}_{k_i,t})\cdot\big(-\tilde{\mathbf{f}}^{xy}_{k_i,t}\big)\cdot\exp\{-\lambda_s\lVert\mathbf{v}_{k_i}\rVert_2^2\},\qquad \mathbf{v}_{k_i}=\begin{bmatrix}x\\y\end{bmatrix}-\hat{\mathbf{o}}^{xy}_{k_i,t}

๋ฒ•์„ ๋ ฅ \bar f^n์€ ์ด ์‹์— ์ง์ ‘ ๋“ค์–ด๊ฐ€์ง€ ์•Š๊ณ  ๋งˆ์ฐฐ ํ•œ๊ณ„๋ฅผ ์ •ํ•˜๋Š” ๋ฐ๋งŒ ์“ฐ์ธ๋‹ค. ์นจํˆฌ ๊นŠ์ด ๊ฐ€์ค‘ -\phi_E๋Š” ๊นŠ์ด ๋ˆŒ๋ฆฐ ๊ณณ์˜ ๋Œ๋ฆผ์„ ๋” ํฌ๊ฒŒ ๋ณด์ด๊ฒŒ ํ•˜๋Š” ์—ญํ• ์ด๋‹ค.

Note๋ถ€ํ˜ธ ๊ทœ์•ฝ์— ๋Œ€ํ•œ ๋ฉ”๋ชจ (ํ•„์ž ํ•ด์„)

์‹์„ ๊ทธ๋Œ€๋กœ ๋”ฐ๋ผ๊ฐ€๋ฉด ๋ถ€ํ˜ธ๊ฐ€ ๋งž์ง€ ์•Š๋Š” ๊ณณ์ด ์žˆ๋‹ค. ์ถ”์ ๊ธฐ F๋Š” ๋ณ€์œ„ \mathbf{d}=\alpha(\mathbf{o}_t-\mathbf{o}_{t-1})๋ฅผ ๋”ํ•ด ๊ฐ€๋ฏ€๋กœ, stick ์ƒํƒœ์—์„œ \hat{\mathbf{f}}_{j,t}\approx(\mathbf{o}_{j,t}-\mathbf{o}_{j,t_0})์˜ ์ ‘์„  ์„ฑ๋ถ„์ด ๋œ๋‹ค(t_0์€ ์ฒ˜์Œ ๋‹ฟ์€ ์‹œ์ ). ๊ทธ๋Ÿฐ๋ฐ \hat{\mathbf{o}}_{j,t}=\mathbf{o}_{j,t}+\hat{\mathbf{f}}_{j,t}๊ฐ€ โ€œ์ฒ˜์Œ ๋‹ฟ์€ ์œ„์น˜โ€๊ฐ€ ๋˜๋ ค๋ฉด \hat{\mathbf{f}}๋Š” \mathbf{o}_{j,t_0}-\mathbf{o}_{j,t}์—ฌ์•ผ ํ•œ๋‹ค. Fig. 3 ์บก์…˜๋„ -\hat{\mathbf{f}}_{j,t}๋ฅผ โ€œ์ฒ˜์Œ ๋‹ฟ์€ ์œ„์น˜์—์„œ ํ˜„์žฌ ์œ„์น˜๋กœ ๊ฐ€๋Š”โ€ ํ™”์‚ดํ‘œ๋กœ ์„ค๋ช…ํ•œ๋‹ค. ๋งˆ์ฐฌ๊ฐ€์ง€๋กœ \mathbf{M}^s์˜ -\tilde{\mathbf{f}}^{xy}๋Š” ๋ˆ„์  ๋ฐฉํ–ฅ์„ ๋”ฐ๋ฅด๋ฉด ๋ฌผ์ฒด ์ด๋™๊ณผ ๋ฐ˜๋Œ€๋ฅผ ํ–ฅํ•˜๋Š”๋ฐ, Fig. 5์˜ ์‹ค์ธกยท์‹œ๋ฎฌ๋ ˆ์ด์…˜ shear๋Š” ์ด๋™ ๋ฐฉํ–ฅ์„ ํ–ฅํ•œ๋‹ค. ๋ณธ๋ฌธ๊ณผ Fig. 3 ์บก์…˜์ด ๊ทธ๋ฆผ์˜ ๊ฐ™์€ ํ™”์‚ดํ‘œ๋ฅผ ๊ฐ๊ฐ (e)์™€ (d)์— ์žˆ๋‹ค๊ณ  ์“ฐ๋Š” ๊ฒƒ๋„ ๊ฐ™์€ ๋ถ€๋ฅ˜์˜ ํ‘œ๊ธฐ ํ”๋“ค๋ฆผ์ด๋‹ค. ๊ฒฐ๊ณผ ๊ทธ๋ฆผ์ด ์‹ค์ธก๊ณผ ๋งž์œผ๋ฏ€๋กœ ๊ตฌํ˜„์€ ์ผ๊ด€๋œ ๋ถ€ํ˜ธ๋ฅผ ์“ฐ๊ณ  ์žˆ์„ ๊ฐ€๋Šฅ์„ฑ์ด ๋†’๋‹ค๊ณ  ๋ดค๋Š”๋ฐ, ๊ณต๊ฐœ ์ฝ”๋“œ๋ฅผ ํ™•์ธํ•˜๋‹ˆ ๊ทธ๋žฌ๋‹ค. ๊ตฌํ˜„์€ ๋ณ€์œ„๋ฅผ \mathbf{o}_{t-1}-\mathbf{o}_t ๋ฐฉํ–ฅ์œผ๋กœ ๋ˆ„์ ํ•ด \hat{\mathbf{o}}=\mathbf{o}+\hat{\mathbf{f}}๊ฐ€ ์ฒ˜์Œ ๋‹ฟ์€ ์œ„์น˜๊ฐ€ ๋˜๊ฒŒ ํ•œ๋‹ค. ๋…ผ๋ฌธ ์‹์˜ ํ‘œ๊ธฐ๋งŒ ์–ด๊ธ‹๋‚˜ ์žˆ์—ˆ๋‹ค.

๋ฌด์—‡์ด ๋ฌด์—‡์„ ํ‘œํ˜„ํ•˜๋Š”๊ฐ€

ํ˜„์ƒ ๋‹ด๋‹นํ•˜๋Š” ์‹ FOTS์™€์˜ ์ฐจ์ด
๊ฒฝ๋กœ ์˜์กด ๋ˆ„์ (stick), hysteresis 2๋‹จ๊ณ„์˜ ์žฌ๊ท€ ๋ง์…ˆ FOTS๋Š” ๊ธฐ์ค€ ์‹œ์  k ๋Œ€๋น„ ๋ฌผ์ฒด ์ค‘์‹ฌ์˜ SE(2) ์ด๋™ ํ•˜๋‚˜๋งŒ ๋ณธ๋‹ค
slip 3๋‹จ๊ณ„์˜ Coulomb clipping(\mu) FOTS๋Š” ์ƒํ•œ \Delta s^{\max}๋กœ ํฌ๊ธฐ๋งŒ ์ž๋ฅธ๋‹ค
์ ‘์ด‰ ๋Š๊น€ ํ›„ ๋ฆฌ์…‹ 3๋‹จ๊ณ„์˜ Heaviside ๋ถ€๋ก A์˜ FOTS ์‹์—๋Š” ๋ณ„๋„ ๋ฆฌ์…‹ ํ•ญ์ด ์—†๋‹ค
SE(3) ํšŒ์ „ยทrolling ํ‘œ๋ฉด์ ๋งˆ๋‹ค 3D ๋ณ€์œ„๋ฅผ ์ถ”์  FOTS๋Š” yaw ํšŒ์ „๋งŒ ๋ณ„๋„ twist ํ•ญ์œผ๋กœ ๋‹ค๋ฃฌ๋‹ค
tactile shadowing dilationยทshear์˜ Gaussian kernel(\lambda_d,\lambda_s) FOTS๋„ kernel์ด ์žˆ์ง€๋งŒ ๋ฌผ์ฒด ์ค‘์‹ฌ ํ•œ ์  \mathbf{G}_t ๊ธฐ์ค€์ด๋‹ค
๋ณต์žกํ•œ ๊ธฐํ•˜ยท๋‹ค์ค‘ ์ ‘์ด‰ patch indenterยทelastomer ๋ชจ๋‘ SDF FOTS๋Š” ๋ฌผ์ฒด ์ค‘์‹ฌ ์ขŒํ‘œ๊ณ„ ํ•˜๋‚˜๋กœ ์ ‘์ด‰์„ ๋Œ€ํ‘œํ•œ๋‹ค

๋ฐฉ๋ฒ• ์ƒ์„ธ 3: ๋ณด์ • (ยงIII-C, ยงIV-A, ๋ถ€๋ก)

ํŒŒ๋ผ๋ฏธํ„ฐ 4๊ฐœ๋ฅผ ํ•œ๊บผ๋ฒˆ์— ์ตœ์ ํ™”ํ•˜์ง€ ์•Š๊ณ  ํ•˜๋‚˜์”ฉ ์ˆœ์„œ๋Œ€๋กœ ๋งž์ถ˜๋‹ค. ์ €์ž๋“ค์˜ ์ด์œ ๋Š” ๊ณ ๋„๋กœ ๋น„์„ ํ˜•์ธ ๊ฒฐํ•ฉ ์ตœ์ ํ™”๊ฐ€ ์ข‹์€ ์ตœ์ ์ ์— ์•ˆ์ •์ ์œผ๋กœ ์ˆ˜๋ ดํ•œ๋‹ค๋Š” ๋ณด์žฅ์ด ์—†์–ด์„œ, ๋‹จ๋ณ€์ˆ˜ ๋ฌธ์ œ๋กœ ์ชผ๊ฐœ ์กฐ๊ฑด์ˆ˜๋ฅผ ๊ฐœ์„ ํ•œ๋‹ค๋Š” ๊ฒƒ์ด๋‹ค.

์ˆœ์„œ ํŒŒ๋ผ๋ฏธํ„ฐ ์˜๋ฏธ ์‹ค์ธก ๋ฐ์ดํ„ฐ(ยงIV-A) ๊ณ ์ •ํ•œ ๊ฐ’
1 \lambda_d dilation ๊ฐ์‡  ๋ฌด์ž‘์œ„ ์œ„์น˜์— ์ˆ˜์ง ์••์ž… 10์ƒ˜ํ”Œ ์—†์Œ (dilation ํ•ญ๋งŒ ์‚ฌ์šฉ)
2 \lambda_s ์ ‘์„  shear ๊ฐ์‡  ์••์ž… ํ›„ ์ ‘์ด‰ ์ƒํƒœ๋กœ ๋ฌด์ž‘์œ„ ๋ฐฉํ–ฅ ์ด๋™ 10์ƒ˜ํ”Œ, ํฌ๊ธฐ ์ •๊ทœํ™” K=1, \mu=10^5
3 K ์ ‘์„  ๊ฐ•์„ฑ 2์™€ ๊ฐ™์€ ๋ฐ์ดํ„ฐ, ์ •๊ทœํ™” ์—†์Œ \lambda_d^\star,\lambda_s^\star, \mu=10^5
4 \mu ๋งˆ์ฐฐ๊ณ„์ˆ˜ ์ ‘์ด‰ ์œ ์ง€ํ•œ ์ฑ„ slip์‹œํ‚ค๋Š” 10์ƒ˜ํ”Œ \lambda_d^\star,\lambda_s^\star,K^\star

๊ฐ ๋‹จ๊ณ„๋Š” ์‹ค์ธก marker ๋ณ€์œ„ \mathbf{Y}_i์™€ ๋ชจ๋ธ ์ถœ๋ ฅ์˜ ์ œ๊ณฑ์˜ค์ฐจ ์ตœ์†Œํ™”๋‹ค. ์˜ˆ๋ฅผ ๋“ค์–ด ๋งˆ์ง€๋ง‰ ๋‹จ๊ณ„๋Š” ๋‹ค์Œ๊ณผ ๊ฐ™๋‹ค.

\mu^\star=\arg\min_{\mu}\sum_{i=1}^n\big\lVert\mathbf{Y}^\mu_i-\mathbf{M}_t\big((x_i,y_i);\lambda_d^\star,\lambda_s^\star,K^\star,\mu\big)\big\rVert_2^2

\mu=10^5๋กœ ๋‘๋ฉด Coulomb cone์ด ์‚ฌ์‹ค์ƒ ์—ด๋ ค slip์ด ์ผ์–ด๋‚˜์ง€ ์•Š์œผ๋ฏ€๋กœ, 2ยท3๋‹จ๊ณ„๋Š” ์ˆœ์ˆ˜ํ•œ stick ์ƒํ™ฉ์—์„œ ๊ฐ์‡ ์™€ ๊ฐ•์„ฑ๋งŒ ๋ณธ๋‹ค. 2๋‹จ๊ณ„์˜ ์ •๊ทœํ™”(๋ถ€๋ก)๋Š” ์‹ค์ธก shear ํฌ๊ธฐ์˜ ํ‰๊ท ยทํ‘œ์ค€ํŽธ์ฐจ๋ฅผ ์‹œ๋ฎฌ๋ ˆ์ด์…˜ ์ชฝ ํ†ต๊ณ„์— ๋งž์ถ”๋˜ ๋ฐฉํ–ฅ์€ ์œ ์ง€ํ•˜๋Š” ๋ณ€ํ™˜์ด๋‹ค.

\hat{\mathbf{Y}}^s_i=\Big[\Big(\frac{\lVert\mathbf{Y}^s_i\rVert-\mu_y}{\sigma_y}\Big)\sigma_m+\mu_m\Big]\frac{\mathbf{Y}^s_i}{\lVert\mathbf{Y}^s_i\rVert}

K์™€ \lambda_s๊ฐ€ ๋‘˜ ๋‹ค shear ํฌ๊ธฐ์— ์˜ํ–ฅ์„ ์ฃผ๋ฏ€๋กœ, \lambda_s๋ฅผ ๋งž์ถœ ๋•Œ๋Š” ํฌ๊ธฐ๋ฅผ ๋–ผ์–ด ๋‚ด๊ณ  shadowing์˜ ๊ณต๊ฐ„ ๊ตฌ์กฐ๋งŒ ๋ณด๊ฒ ๋‹ค๋Š” ์˜๋„๋‹ค. \mu๋Š” ์ ‘์„  ์ด๋™ ์ค‘ shear๊ฐ€ ์„ ํ˜•์œผ๋กœ ๋Š˜๋‹ค๊ฐ€ ํฌํ™”ํ•˜๋Š” ์ง€์ ์„ ๋งž์ถฐ ์ถ”์ •ํ•˜๋ฉฐ, ์ €์ž๋“ค์€ ์ด ๋•๋ถ„์— ๋ณ„๋„ force-torque ์„ผ์„œ ์—†์ด ๋งˆ์ฐฐ์„ ์ถ”์ •ํ•  ์ˆ˜ ์žˆ๋‹ค๊ณ  ์“ด๋‹ค. ๋ฏธํ„ฐ ๋‹จ์œ„ ๋ณ€์œ„๋ฅผ ํ”ฝ์…€๋กœ ๋ฐ”๊พธ๋Š” ๋ฐฐ์œจ์€ GelSight Mini ์นด๋ฉ”๋ผ ํ•ด์ƒ๋„์—์„œ 1000/0.065 [px/m]๋กœ ๋‘”๋‹ค.


Fig. 4. Digital twin ๋ณด์ • ์…‹์—…. 7-DoF KUKA MED LBR ๋๋‹จ์˜ 35 mm sphere indenter๊ฐ€ ํ…Œ์ด๋ธ”์— ๊ณ ์ •๋œ GelSight Mini๋ฅผ ๋ˆ„๋ฅด๊ณ  ๋ˆ๋‹ค. ๊ฐ™์€ ๊ถค์ ์„ digital twin์—์„œ ์žฌ์ƒํ•ด ๊ฐ ๋ฐฉ๋ฒ•์˜ ์ถœ๋ ฅ๊ณผ ์‹ค์ธก์„ ๋น„๊ตํ•œ๋‹ค. ๋ณด์ • ์ค‘ ์„ผ์„œ์™€ indenter์˜ ์ „์ฒด ์ž์„ธ๋Š” ์•Œ๋ ค์ ธ ์žˆ๋‹ค๊ณ  ๊ฐ€์ •ํ•œ๋‹ค.

๋ณด์ • ์ ˆ์ฐจ์—๋Š” ๋ณธ๋ฌธ ์•ˆ์—์„œ ์„œ๋กœ ๋‹ค๋ฅธ ์„œ์ˆ ์ด ์žˆ๋‹ค. ยงIII-C์™€ ๋ถ€๋ก์€ \lambda_s์™€ K๋ฅผ ๋”ฐ๋กœ ์ˆœ์„œ๋Œ€๋กœ ๋งž์ถ˜๋‹ค๊ณ  ์“ฐ๋Š”๋ฐ, ยงIV-A๋Š” ๊ฐ™์€ 10์ƒ˜ํ”Œ๋กœ โ€œ\lambda_s์™€ K๋ฅผ ํ•จ๊ป˜(jointly) ์ตœ์ ํ™”ํ•œ๋‹คโ€๊ณ  ์“ด๋‹ค. ๋˜ ๋ณด์ •์ด ๋๋‚œ ๋„ค ๊ฐ’ ์ž์ฒด๋Š” ๋…ผ๋ฌธ ์–ด๋””์—๋„ ์ˆซ์ž๋กœ ๋‚˜์˜ค์ง€ ์•Š๋Š”๋‹ค. ๊ฐ™์€ GelSight Mini๋ฅผ ์“ฐ๋Š” ๋…์ž๊ฐ€ ๊ฐ’์„ ๊ทธ๋Œ€๋กœ ๊ฐ€์ ธ๋‹ค ์“ธ ์ˆ˜๋Š” ์—†๊ณ , ๊ณต๊ฐœ ์ฝ”๋“œ์—์„œ ํ™•์ธํ•ด์•ผ ํ•œ๋‹ค.

๋ฐฉ๋ฒ• ์ƒ์„ธ 4: Sim-to-real RL (ยงIII-D, ๋ถ€๋ก)

์ •์‹ํ™”์™€ ํ•™์Šต ํŒŒ์ดํ”„๋ผ์ธ

๊ณผ์ œ๋Š” ๋ฌดํ•œ ์ง€ํ‰ discrete-time POMDP \mathcal{M}=(\mathcal{S},\mathcal{O},\mathcal{A},\mathcal{R},\mathcal{P},\rho_0,\gamma)๋กœ ๋‘”๋‹ค. ์‹œ๋ฎฌ๋ ˆ์ด์…˜๊ณผ ์‹ค์ œ์˜ ์ฐจ์ด๋Š” ์ƒํƒœ ์ ‘๊ทผ ์—ฌ๋ถ€ ํ•˜๋‚˜๋ฟ์ด๋‹ค. ํ•™์Šต์€ Isaac Gym์˜ ๋ณ‘๋ ฌ ํ™˜๊ฒฝ์—์„œ PPO๋กœ ํ•˜๊ณ , ์‹ค์ œ ๋ฐฐํฌ๋Š” ์ˆ˜์ •ยทfine-tuning ์—†๋Š” zero-shot์ด๋‹ค. ์ˆœ์„œ๋Š” ๋‹ค์Œ๊ณผ ๊ฐ™๋‹ค(๋ถ€๋ก Sim-to-Real Transfer Pipeline).

  1. privileged ์ƒํƒœ(๋ฌผ์ฒด ์ž์„ธยท์†๋„, ์ ‘์ด‰๋ ฅ, ๋ฌผ๋ฆฌ ํŒŒ๋ผ๋ฏธํ„ฐ ๋“ฑ)๋ฅผ ๋ฐ›๋Š” teacher actor-critic์„ contact penalty ์—†์ด ํ•™์Šตํ•ด ๊ฐ€์žฅ ํšจ์œจ์ ์ธ ํ•ด๋ฅผ ์ฐพ๋Š”๋‹ค.
  2. ๊ฐ™์€ teacher๋ฅผ contact penalty๋ฅผ ์ผœ๊ณ  fine-tuningํ•œ๋‹ค. ์ฒ˜์Œ๋ถ€ํ„ฐ penalty๋ฅผ ๊ฑธ๋ฉด ๋ชฉํ‘œ์™€์˜ ์ ‘์ด‰์„ ์•„์˜ˆ ํ”ผํ•˜๋Š” ์ •์ฑ…์œผ๋กœ ๋ถ•๊ดดํ•˜๊ธฐ ๋•Œ๋ฌธ์ด๋‹ค.
  3. fine-tuning๋œ teacher์˜ critic์œผ๋กœ student actor๋ฅผ ์ฒ˜์Œ๋ถ€ํ„ฐ ํ•™์Šตํ•œ๋‹ค. TacSL์ด ์ œ์•ˆํ•œ Asymmetric Actor-Critic Distillation(AACD)์ด๋‹ค. ๊ณผ์ œ๋งˆ๋‹ค ํ•˜๋‚˜์˜ teacher critic checkpoint๋ฅผ ๋ชจ๋“  student(๋ชจ๋“  ์‹œ๋ฎฌ๋ ˆ์ดํ„ฐ ์กฐ๊ฑด)๊ฐ€ ๊ณต์œ ํ•œ๋‹ค.
  4. student actor๋ฅผ ์‹ค์ œ ๋กœ๋ด‡์— ๊ทธ๋Œ€๋กœ ์˜ฌ๋ฆฐ๋‹ค.

Fig. 2. AACD ๊ธฐ๋ฐ˜ teacher-student ํ•™์Šต. Stage 1: privileged state๋กœ teacher actor-critic ํ•™์Šต. Stage 2: ์‚ฌ์ „ํ•™์Šต๋œ teacher critic์œผ๋กœ ์ดˆ๊ธฐํ™”ํ•œ critic๊ณผ, ์ฒ˜์Œ๋ถ€ํ„ฐ ํ•™์Šตํ•˜๋Š” student actor(EE ์ž์„ธ, EE-๋ชฉํ‘œ ์ƒ๋Œ€ ์ž์„ธ, ์ขŒ์šฐ tactile shear ์ž…๋ ฅ). ๋‘˜ ๋‹ค PPO๋กœ ์ตœ์ ํ™”ํ•˜๊ณ  encoder-LSTM-MLP ๊ตฌ์กฐ๋‹ค. Stage 3: student actor๋ฅผ ์‹ค์ œ์— ๋ฐฐํฌ.

AACD๋Š” ํ–‰๋™ ๋ณต์ œ๊ฐ€ ์•„๋‹ˆ๋‹ค. student๋Š” teacher์˜ ํ–‰๋™์„ ๋”ฐ๋ผ ํ•˜๋Š” ๊ฒƒ์ด ์•„๋‹ˆ๋ผ teacher์˜ ๊ฐ€์น˜ ํ•จ์ˆ˜๋กœ ์‹œ์ž‘ํ•œ critic ์•„๋ž˜์„œ ์ž๊ธฐ ๊ด€์ธก์œผ๋กœ PPO๋ฅผ ๋ˆ๋‹ค. ๊ทธ๋ž˜์„œ student๋Š” ์ด‰๊ฐ์œผ๋กœ ์–ป์„ ์ˆ˜ ์žˆ๋Š” ์ •๋ณด๋กœ ํ’€ ์ˆ˜ ์žˆ๋Š” ํ•ด๋ฅผ ์Šค์Šค๋กœ ์ฐพ๋Š”๋‹ค. ๊ฐ™์€ ๋ธ”๋กœ๊ทธ์˜ Which Taxels๊ฐ€ DAgger๋กœ teacher ํ–‰๋™์„ ํšŒ๊ท€ํ•˜๋Š” ๊ฒƒ๊ณผ ๋Œ€์กฐ๋œ๋‹ค.

๊ด€์ธกยทํ–‰๋™ยท๋ณด์ƒ

student ๊ด€์ธก์€ EE ์ž์„ธ(๋ชฉํ‘œ ๋˜๋Š” socket ์ขŒํ‘œ๊ณ„, 7์ฐจ์›; Drawer Pulling์€ 9์ฐจ์›)์™€ ์ขŒ์šฐ ์„ผ์„œ์˜ tactile shear field๋‹ค. ์‹œ๊ฐ ์ž…๋ ฅ์€ ์—†๋‹ค. ๋ชฉํ‘œ ์ž์„ธ๋Š” ์•Œ๋ ค์ ธ ์žˆ์œผ๋ฏ€๋กœ ์ด ๊ณผ์ œ๋“ค์€ โ€œ์–ด๋””๋กœ ๊ฐ€์•ผ ํ•˜๋Š”์ง€๋Š” ์•Œ์ง€๋งŒ, ์† ์•ˆ์˜ ๋ฌผ์ฒด๊ฐ€ ์ •ํ™•ํžˆ ์–ด๋–ป๊ฒŒ ๋†“์˜€๋Š”์ง€์™€ ๋ฌด์—‡์— ๊ฑธ๋ ธ๋Š”์ง€๋Š” ์ด‰๊ฐ์œผ๋กœ๋งŒ ์•ˆ๋‹คโ€๋Š” ์„ค์ •์ด๋‹ค.

ํ–‰๋™์€ ๊ณผ์ œ ๊ณตํ†ต์œผ๋กœ EE ์ž์„ธ ๋ณ€ํ™”๋Ÿ‰ \Delta\mathbf{X}^{ee}\in\mathbb{R}^7์™€ Cartesian impedance์˜ stiffness \mathbf{K}_p\in\mathbb{R}^6, damping \mathbf{K}_d\in\mathbb{R}^6์ด๋‹ค. ์ •์ฑ…์ด impedance gain๊นŒ์ง€ ์ง์ ‘ ๊ณ ๋ฅธ๋‹ค๋Š” ์ ์ด ์ ‘์ด‰ ๊ณผ์ œ์—์„œ ์ค‘์š”ํ•˜๋‹ค. Drawer Pulling์€ ์—ฌ๊ธฐ์— gripper ๋ชฉํ‘œ ์œ„์น˜ 1์ฐจ์›์ด ๋”ํ•ด์ง„๋‹ค(Table VI).

์‚ฝ์ž… ๊ณผ์ œ์˜ ๋ณด์ƒ์€ keypoint ์ •๋ ฌ, contact penalty, action ๋ณ€ํ™” penalty์˜ ํ•ฉ์ด๋‹ค.

R=\alpha_{\text{keypoint}}\,r_{\text{keypoint}}+\alpha_{\text{centered}}\,r_{\text{contact}}+r_{\text{action\_grad}}

r_{\text{keypoint}}=\sum_{i=1}^4-\lambda_{\text{kpt}}e_i+\frac{\lambda_{\text{exp}}}{n+e^{me_i}+e^{-me_i}},\quad e_i=\lVert\hat{\mathbf{y}}_i-\mathbf{y}_i\rVert_2^2

r^{(t)}_{\text{contact}}=-\lambda_{\text{contact}}\sum_{b\in\mathcal{B}^{\text{task}}_{\text{env}}}\lVert\mathbf{f}^{(t)}_{\text{obj},b}\rVert_2,\qquad r_{\text{action\_grad}}=-\lambda_{\text{action}}\lVert\mathbf{a}_t-\mathbf{a}_{t-1}\rVert_2^2

\alpha_{\text{keypoint}}๋Š” ๋ฌผ์ฒด๊ฐ€ ๋ชฉํ‘œ ๋†’์ด์— ์žˆ๋Š”๋ฐ xy๊ฐ€ ์–ด๊ธ‹๋‚˜ ์žˆ์œผ๋ฉด(์˜†์—์„œ ์ ‘๊ทผ) 10, ์•„๋‹ˆ๋ฉด 1์ด๋‹ค. \alpha_{\text{centered}}๋Š” ๋ฌผ์ฒด๊ฐ€ ๋ชฉํ‘œ ์ค‘์‹ฌ์— ์ •๋ ฌ๋˜๋ฉด 0.001, ์•„๋‹ˆ๋ฉด 1.0์œผ๋กœ, ์ •๋ ฌ๋œ ๋’ค์˜ ์‚ฝ์ž… ์ ‘์ด‰์€ ๋ฒŒํ•˜์ง€ ์•Š๊ฒŒ ํ•œ๋‹ค. Drawer Pulling์€ ๋‘ \alpha๋ฅผ ๋นผ๊ณ  ์™ธ๋ž€ ์ „์— gripper๋ฅผ ๋ฏธ๋ฆฌ ์„ธ๊ฒŒ ์ฅ๋ฉด ๋ฒŒํ•˜๋Š” ํ•ญ์„ ๋”ํ•œ๋‹ค.

r_{\text{perturb}}=\begin{cases}-\lambda_{\text{perturb}} & \text{grasp\_width}<\beta\ \&\ \text{perturb}>0\\ 0 & \text{else}\end{cases}

๋ถ€๋ก์€ ์ด ํ•ญ์„ โ€œ์™ธ๋ž€์ด ์ผ์–ด๋‚˜๊ธฐ ์ „์— ์„ธ๊ฒŒ ์ฅ๋ฉด ๋ฒŒํ•œ๋‹คโ€๊ณ  ์„ค๋ช…ํ•˜๋Š”๋ฐ, ์กฐ๊ฑด์‹์€ ์™ธ๋ž€ ํฌ๊ธฐ๊ฐ€ 0๋ณด๋‹ค ํด ๋•Œ๋กœ ์ ํ˜€ ์žˆ์–ด ๋ฌธ์žฅ๊ณผ ์‹์ด ๋ฐ˜๋Œ€๋กœ ์ฝํžŒ๋‹ค. Table VI์˜ ๋ณด์ƒ ๋ชฉ๋ก์€ โ€œPre-ForcePerturb Gripper Penaltyโ€์™€ ๋ณ„๊ฐœ๋กœ ์™ธ๋ž€ ์ค‘ ๋ฒ•์„ ๋ ฅ ํ•ฉ์„ ์ฃผ๋Š” โ€œPost-ForcePerturb Gripper Rewardโ€๊นŒ์ง€ ๋‘ ํ•ญ์„ ๋‚˜์—ดํ•ด, ๋ถ€๋ก ์‹๊ณผ Table VI์˜ ํ•ญ ๊ตฌ์„ฑ๋„ ์ผ์น˜ํ•˜์ง€ ์•Š๋Š”๋‹ค.

๋ณด์ƒ ํŒŒ๋ผ๋ฏธํ„ฐ (Table X) ๊ฐ’
m 50
n 0.0001
\beta (grasp ํญ ๋ฌธํ„ฑ, m) 0.0029
\lambda^{\text{stage\_1}}_{\text{contact}} / \lambda^{\text{stage\_2}}_{\text{contact}} 0 / 0.001
\lambda_{\text{action}} 0.001
\lambda_{\text{exp}}, \lambda_{\text{kpt}}, \lambda_{\text{perturb}} 0.1, 0.1, 0.1

๋„คํŠธ์›Œํฌ์™€ ํ•˜์ดํผํŒŒ๋ผ๋ฏธํ„ฐ (๋ถ€๋ก B)

actor์™€ critic์€ ๊ฐ™์€ backbone(2-layer LSTM 256 unit โ†’ MLP [512, 128, 64], ELU)์„ ๋”ฐ๋กœ ๊ฐ€์ง„๋‹ค. ์ž…๋ ฅ encoder๋งŒ ๋‹ค๋ฅด๋‹ค.

์ž…๋ ฅ ํ•ด์ƒ๋„ encoder
shear (HydroShearยทFOTSยทTacSL Shear) ์„ผ์„œ๋‹น [2\times7\times9] marker grid (์‹ค์ œ GelSight Mini dotted gel ๋ฐฐ์น˜์™€ ์ผ์น˜) Conv 3์ธต [32, 64, 64], kernel 3, stride 1, ์•ž ๋‘ ์ธต๋งŒ padding, ReLU, spatial soft-argmax
TacSL grayscale ์ด๋ฏธ์ง€ [3\times320\times240] โ†’ [3\times80\times60] Conv 3์ธต [32, 64, 64], kernel [8, 4, 3], ์ฒซ ์ธต stride 2, padding ์—†์Œ, ReLU, spatial soft-argmax

MDP ํ‘œ(Table III~VI)๋Š” shear ๊ด€์ธก์„ \mathbb{R}^{H\times W\times3}๋กœ ์ ์–ด ๋ถ€๋ก ๋ณธ๋ฌธ์˜ 2์ฑ„๋„ grid์™€ ์ฑ„๋„ ์ˆ˜๊ฐ€ ๋‹ค๋ฅด๋‹ค. ์‚ฌ์†Œํ•˜์ง€๋งŒ ์žฌํ˜„ํ•  ๋•Œ ํ™•์ธํ•  ๋ถ€๋ถ„์ด๋‹ค.

PPO (Table VIIยทVIII) teacher student
discount / GAE 0.99 / 0.95 0.99 / 0.95
clip / grad norm / entropy 0.2 / 1.0 / 0.0 0.2 / 1.0 / 0.0
policy / value loss coeff. 1.0 / 2.0 1.0 / 2.0
base LR / max LR 1e-4 / 1e-2 1e-4 / 1e-4
adaptive LR KL target 2e-3 8e-3
ํ™˜๊ฒฝ ์ˆ˜ 1024 256
episode ๊ธธ์ด / mini-epochs / minibatch 256 / 4 / 1024 256 / 4 / 1024

Fig. 8. ๊ณผ์ œ๋ณ„ teacher ํ•™์Šต ๊ณก์„ . ๋นˆ ์›์—์„œ ์ฑ„์šด ์›์œผ๋กœ ๋–จ์–ด์ง€๋Š” ์ง€์ ์ด contact penalty๋ฅผ ์ผ  fine-tuning ์‹œ์ž‘์ด๋‹ค. Drawer Pulling์€ ๊ทธ ์ˆœ๊ฐ„ ์„ฑ๊ณต๋ฅ ์ด 0 ๊ทผ์ฒ˜๊นŒ์ง€ ๋–จ์–ด์กŒ๋‹ค๊ฐ€ ํšŒ๋ณตํ•˜๊ณ , Book Shelving์€ ์•ฝ 0.45๊นŒ์ง€, Bin Packing์€ ์•ฝ 0.9๊นŒ์ง€ ๋–จ์–ด์ง„๋‹ค(๊ทธ๋ฆผ์—์„œ ์ฝ์€ ๊ฐ’).

์ง๊ด€: ์ •๊ทœํ™”๋œ shear์™€ ๊ธฐ์–ตํ•˜๋Š” shear

์„ธ ๋ฐฉ๋ฒ•์˜ ์ฐจ์ด๋ฅผ โ€œ๋ฌด์—‡์„ ๊ธฐ์–ตํ•˜๋А๋ƒโ€๋กœ ์ •๋ฆฌํ•˜๋ฉด ๊ฒฐ๊ณผํ‘œ๊ฐ€ ์ฝํžŒ๋‹ค.

  • TacSL Shear๋Š” ์•„๋ฌด๊ฒƒ๋„ ๊ธฐ์–ตํ•˜์ง€ ์•Š๊ณ , ํฌ๊ธฐ๋ฅผ ๋ฒ„๋ฆฐ๋‹ค. ๊ฐ taxel์˜ shear๋ฅผ unit vector๋กœ ์ •๊ทœํ™”ํ•˜๋ฉด ๋ฐฉํ–ฅ ํŒจํ„ด๋งŒ ๋‚จ๋Š”๋‹ค. ์† ์•ˆ ์ž์„ธ๋‚˜ ๋ฏธ๋„๋Ÿฌ์ง ๋ฐฉํ–ฅ์ฒ˜๋Ÿผ ๋ฐฉํ–ฅ์ด ํ•ต์‹ฌ์ธ ๊ณผ์ œ(Peg Insertion, Drawer Pulling)์—์„œ๋Š” ์ด๊ฒƒ์œผ๋กœ ์ถฉ๋ถ„ํ•˜๋‹ค. ํ•˜์ง€๋งŒ Bin Packing์ฒ˜๋Ÿผ ์—ฌ๋Ÿฌ cube์™€ ๋น„ํ‹€๋ฆฌ๋ฉฐ ๋ถ€๋”ชํ˜€ elastomer ์ „์ฒด๊ฐ€ ํฌ๊ฒŒ ๋ณ€ํ˜•๋˜๋ฉด, ์ •๊ทœํ™”๋œ field๋Š” ํ•™์Šต ๋•Œ ๋ณธ ๊ฒƒ๋ณด๋‹ค ํ›จ์”ฌ ๋„“์€ patch์—์„œ ๊ฐ™์€ ํฌ๊ธฐ์˜ ํ™”์‚ดํ‘œ๋ฅผ ๋‚ด๋†“๋Š”๋‹ค. ์ €์ž๋“ค์€ ์ด๊ฒƒ์„ Bin Packing 4/30์˜ ์›์ธ์œผ๋กœ ๋“ ๋‹ค.
  • FOTS๋Š” ๋ฌผ์ฒด ์ค‘์‹ฌ ํ•˜๋‚˜๋งŒ ๊ธฐ์–ตํ•œ๋‹ค. shear์™€ twist๊ฐ€ ๋ชจ๋‘ ๋ฌผ์ฒด ์ขŒํ‘œ๊ณ„ ์›์ ์˜ 2D ์‚ฌ์˜ \mathbf{G}_t ๊ธฐ์ค€์ด๋ผ, ์›์ ์ด ์‹ค์ œ ์ ‘์ด‰ patch์™€ ๋ฉ€๋ฉด shear field๊ฐ€ ์—‰๋šฑํ•œ ๊ณณ์„ ์ค‘์‹ฌ์œผ๋กœ ๊ทธ๋ ค์ง„๋‹ค. ์› FOTS๊ฐ€ peg(์›์ ์ด peg ์ค‘์‹ฌ, ์ ‘์ด‰์€ ์ธก๋ฉด)์™€ cube์—์„œ 1/30, 5/30์— ๊ทธ์นœ ๋ฐ˜๋ฉด, ์›์ ๊ณผ ์ ‘์ด‰ patch๊ฐ€ ๊ฐ€๊นŒ์šด ์ฑ…ยท์†์žก์ด์—์„œ 20/30, 15/30์ด ๋‚˜์˜จ ๊ฒƒ๊ณผ ๋งž๋Š”๋‹ค. ์ €์ž ๊ฐœ๋Ÿ‰ํŒ์€ ๊ธฐ์ค€์ ์„ ์ดˆ๊ธฐ ์ ‘์ด‰ patch ์ค‘์‹ฌ์œผ๋กœ ์˜ฎ๊ฒจ ์ด ๋ฌธ์ œ๋ฅผ ๊ณ ์นœ๋‹ค. ๊ทธ๋Ÿฌ๋‚˜ ์ ‘์ด‰์ด ์ž์ฃผ ๋ฐ”๋€Œ๋Š” Drawer Pulling์—์„œ๋Š” โ€œ์ดˆ๊ธฐ patchโ€ ์ž์ฒด๊ฐ€ ์ž˜ ์ •์˜๋˜์ง€ ์•Š๋Š”๋‹ค.
  • HydroShear๋Š” ์ ‘์ด‰์ ๋งˆ๋‹ค ๋”ฐ๋กœ ๊ธฐ์–ตํ•œ๋‹ค. ๊ธฐ์ค€์ ์ด ํ•˜๋‚˜๊ฐ€ ์•„๋‹ˆ๋ผ ํ‘œ๋ฉด์  ์ˆ˜์ฒœ ๊ฐœ์ด๊ณ , ๊ฐ์ž ๋ถ™์€ ์œ„์น˜์™€ ๋Œ๋ ค์˜จ ์–‘์„ ๋”ฐ๋กœ ๋“ค๊ณ  ์žˆ๋‹ค. ์ ‘์ด‰์ด ๋ฐ”๋€Œ๋ฉด ์ƒˆ๋กœ ๋‹ฟ์€ ์ ์€ 0๋ถ€ํ„ฐ, ๋–จ์–ด์ง„ ์ ์€ ๋ฆฌ์…‹๋œ๋‹ค. ๊ทธ๋ž˜์„œ ์ ‘์ด‰ ๊ตฌ์„ฑ์ด ๊ณ„์† ๋ณ€ํ•ด๋„ shear field๊ฐ€ ์‹ค์ œ elastomer์˜ ์ƒํƒœ์™€ ์–ด๊ธ‹๋‚˜์ง€ ์•Š๋Š”๋‹ค๋Š” ๊ฒƒ์ด ์ €์ž๋“ค์˜ ์„ค๋ช…์ด๋‹ค.

๋‹ค๋งŒ ์ด ์„ค๋ช…์—๋Š” ํ•œ ๊ฐ€์ง€ ๋‹จ์„œ๊ฐ€ ๋ถ™๋Š”๋‹ค. ๋ถ€๋ก B๋Š” student์˜ ์‹œ๋ฎฌ๋ ˆ์ด์…˜ ํ•™์Šต ๊ณก์„ ์ด ๋ฐฉ๋ฒ• ๊ฐ„์— โ€œon parโ€๋ผ๊ณ  ์“ฐ๊ณ , ๋” ์ •ํ™•ํ•œ ๋ฌผ๋ฆฌ๋Š” stick-slip๊ณผ ๊ฒฝ๋กœ ์˜์กด์„ฑ ๋•Œ๋ฌธ์— ์‹œ๋ฎฌ๋ ˆ์ด์…˜ ํ•™์Šต์„ ์˜คํžˆ๋ ค ์–ด๋ ต๊ฒŒ ๋งŒ๋“ค ์ˆ˜ ์žˆ๋‹ค๊ณ  ๋ง๋ถ™์ธ๋‹ค. ์ฆ‰ HydroShear๋Š” ์‹œ๋ฎฌ๋ ˆ์ด์…˜ ์•ˆ์—์„œ ๋” ์ž˜ํ•˜๋Š” ๋ฐฉ๋ฒ•์ด ์•„๋‹ˆ๋ผ, ์‹œ๋ฎฌ๋ ˆ์ด์…˜์—์„œ ๋ฐฐ์šด ๊ฒƒ์ด ์‹ค์ œ์—์„œ๋„ ์„ฑ๋ฆฝํ•˜๊ฒŒ ๋งŒ๋“œ๋Š” ๋ฐฉ๋ฒ•์ด๋ผ๋Š” ๊ฒƒ์ด ์ €์ž๋“ค์˜ ์ž…์žฅ์ด๋‹ค. ์ด ์ž…์žฅ์ด ์‹คํ—˜๊ณผ ์–ผ๋งˆ๋‚˜ ๋งž๋Š”์ง€๋Š” ์•„๋ž˜ ์‹คํ—˜ ์ ˆ์—์„œ Fig. 9~12์™€ ํ•จ๊ป˜ ๋‹ค์‹œ ๋ณธ๋‹ค.

์‹คํ—˜ 1: Shear ์ถฉ์‹ค๋„ (ยงIV-A, Table I, Fig. 5ยท6ยท13)

์…‹์—…๊ณผ ๋ฒ ์ด์Šค๋ผ์ธ

๋ณด์ • 30์ƒ˜ํ”Œ๊ณผ ๋ณ„๋„๋กœ, ์ฒ˜์Œ ๋ณด๋Š” ์ ‘์ด‰ ๊ตฌ์„ฑ์˜ ๊ฒ€์ฆ ๋ฐ์ดํ„ฐ๋ฅผ dilation, translational shear, twist(torsional shear), roll ์œ ํ˜•๋ณ„๋กœ 10์ƒ˜ํ”Œ์”ฉ ์ด 40์ƒ˜ํ”Œ ๋ชจ์•˜๋‹ค. ๋ชจ๋“  ์ƒ˜ํ”Œ์€ ๊ฐ™์€ 35 mm sphere indenter๋‹ค. ์ง€ํ‘œ๋Š” ์˜ˆ์ธกยท์‹ค์ธก shear ๋ฒกํ„ฐ์˜ per-taxel RMSE [px]์™€ ํ‰๊ท  cosine similarity(CS)์ด๊ณ , taxel ์ „์ฒด์— ๋Œ€ํ•ด ํ‰๊ท ํ•œ๋‹ค.

๋ฒ ์ด์Šค๋ผ์ธ ๋‘ ๊ฐœ๋Š” ๊ฐ์ž์˜ ์›๋ž˜ ๋ณด์ • ์ ˆ์ฐจ๋ฅผ ๋”ฐ๋ฅด๋˜ ๊ฐ™์€ ์‹ค์ธก ๋ณด์ • ๋ฐ์ดํ„ฐ๋กœ ํŒŒ๋ผ๋ฏธํ„ฐ๋ฅผ ๋งž์ท„๋‹ค.

  • TacSL: Isaac Gym์˜ penalty ๊ธฐ๋ฐ˜ force field. ๋ฌผ์ฒด SDF์™€ elastomer ๋Œ€๋น„ ์ƒ๋Œ€ ์†๋„๋กœ grid ์ ์˜ ์ ‘์ด‰๋ ฅ์„ ์ถ”์ •ํ•œ๋‹ค.
  • FOTS: marker ๋ณ€์œ„์žฅ์„ dilation, shear, twist ์„ธ ์„ฑ๋ถ„์˜ ํ•ฉ์œผ๋กœ ๋‘๊ณ  ๋ฌผ์ฒด ์šด๋™์„ SE(2)๋กœ ์ถ”์ ํ•œ๋‹ค(๋ถ€๋ก A).

๊ฒฐ๊ณผ

Table I. ์œ ํ˜•๋ณ„ per-taxel shear RMSE [px]์™€ cosine similarity. ๊ตต๊ฒŒ๋Š” ์› ํ‘œ์˜ ๊ฐ•์กฐ.
๋ฐฉ๋ฒ• Dilation RMSEโ†“ CSโ†‘ Shear RMSE CS Twist RMSE CS Roll RMSE CS
TacSL 2.187 0.323 4.262 0.126 4.022 0.157 3.861 0.137
FOTS 1.333 0.976 2.146 0.930 3.596 0.683 2.841 0.561
HydroShear 1.000 0.976 1.719 0.951 2.021 0.974 1.576 0.904

๋„ค ์œ ํ˜•์„ ๋‹จ์ˆœ ํ‰๊ท ํ•˜๋ฉด RMSE๋Š” HydroShear 1.58, FOTS 2.48, TacSL 3.58์ด๊ณ  CS๋Š” 0.951, 0.788, 0.186์ด๋‹ค(ํ•„์ž ๊ณ„์‚ฐ). ์ฝ์„ ์ง€์ ์€ ์„ธ ๊ฐ€์ง€๋‹ค.

  1. dilation๊ณผ translational shear์—์„œ๋Š” FOTS์™€์˜ ์ฐจ์ด๊ฐ€ ์ž‘๋‹ค. dilation CS๋Š” ๊ฐ™๊ณ (๊ณต์œ ํ•˜๋Š” ์‹์ด๋‹ˆ ๋‹น์—ฐํ•˜๋‹ค), shear CS๋„ 0.930 vs 0.951์ด๋‹ค. ์ฐจ์ด๋Š” twist์™€ roll์—์„œ ๋ฒŒ์–ด์ง„๋‹ค(CS 0.683 โ†’ 0.974, 0.561 โ†’ 0.904).
  2. ๋ณธ๋ฌธ ํ•ด์„๊ณผ ํ‘œ ์‚ฌ์ด์— ์–ด๊ธ‹๋‚จ์ด ํ•˜๋‚˜ ์žˆ๋‹ค. ๋ณธ๋ฌธ์€ โ€œFOTS๋Š” in-plane ์šด๋™์—์„œ๋Š” ๋น„์Šทํ•˜๊ณ , out-of-plane ์„ฑ๋ถ„์ด ์žˆ๋Š” tilt ์šด๋™์—์„œ ์ •ํ™•๋„๊ฐ€ ๋–จ์–ด์ง„๋‹คโ€๊ณ  ์“ด๋‹ค. ๊ทธ๋Ÿฐ๋ฐ twist๋Š” ์„ผ์„œ ๋ฒ•์„ ์ถ• ํšŒ์ „, ์ฆ‰ in-plane ์šด๋™์ด๊ณ  FOTS๊ฐ€ ๋ณ„๋„ twist ํ•ญ์œผ๋กœ ๋ชจ๋ธ๋งํ•˜๋Š” ์œ ํ˜•์ธ๋ฐ๋„ CS 0.683์œผ๋กœ ํฌ๊ฒŒ ๋–จ์–ด์ง„๋‹ค. Fig. 5์˜ FOTS twist ์ƒ˜ํ”Œ์€ ํšŒ์ „ ํŒจํ„ด์ด ๊ฑฐ์˜ ๋ณด์ด์ง€ ์•Š๋Š”๋‹ค. FOTS์˜ ์•ฝ์ ์€ out-of-plane๋งŒ์ด ์•„๋‹ˆ๋ผ โ€œํšŒ์ „ ์ค‘์‹ฌ์„ ๋ฌผ์ฒด ์›์  ํ•œ ์ ์œผ๋กœ ๋‘๋Š” ๊ฒƒโ€ ์ „๋ฐ˜์ด๋ผ๊ณ  ์ฝ๋Š” ํŽธ์ด ํ‘œ์™€ ๋งž๋Š”๋‹ค.
  3. TacSL์˜ CS๊ฐ€ 0.12~0.32๋กœ ๋งค์šฐ ๋‚ฎ๋‹ค. ๋ฐฉํ–ฅ์กฐ์ฐจ ๊ฑฐ์˜ ๋งž์ง€ ์•Š๋Š”๋‹ค๋Š” ๋œป์ธ๋ฐ, ์ €์ž๋“ค์€ shadowing ๋ถ€์žฌ๋ฅผ ์›์ธ์œผ๋กœ ๋“ ๋‹ค. ๊ทธ๋ ‡๋‹ค๋ฉด ๊ฐ™์€ TacSL shear๋ฅผ per-taxel๋กœ ์ •๊ทœํ™”ํ•œ TacSL Shear ์ •์ฑ…์ด Table II์—์„œ 70/120์œผ๋กœ ์› FOTS(41/120)๋ณด๋‹ค ๋†’๋‹ค๋Š” ๊ฒฐ๊ณผ์™€ ํ•จ๊ป˜ ์ฝ์–ด์•ผ ํ•œ๋‹ค. shear field ์ถฉ์‹ค๋„์™€ ์ •์ฑ… ์„ฑ๊ณต๋ฅ ์ด ๋‹จ์กฐ ๊ด€๊ณ„๋Š” ์•„๋‹ˆ๋‹ค.

Fig. 5. ๋ณด์ • ์ƒ˜ํ”Œ. ํ–‰์€ dilation, translational shear, twist, roll์ด๊ณ  ์—ด์€ ์‹ค์ธก, HydroShear, FOTS, TacSL. ๋นจ๊ฐ„ ์›์€ sphere์˜ ์ ‘์ด‰ patch, ์ดˆ๋ก ํ™”์‚ดํ‘œ๋Š” shear field(์‹ค์ œ ํฌ๊ธฐ ์•„๋‹˜, ์ƒ˜ํ”Œ ๊ฐ„ ์ถ•์ฒ™์€ ๊ฐ™์Œ). ์•„๋ž˜ ์ˆซ์ž๋Š” ์ด ์ƒ˜ํ”Œ ํ•œ ๊ฐœ์˜ RMSEยทCS๋กœ, Table I ํ‰๊ท ๊ณผ ๋‹ค๋ฅด๋‹ค(์˜ˆ: dilation ์ƒ˜ํ”Œ์—์„œ๋Š” FOTS CS 0.963์ด HydroShear 0.962๋ณด๋‹ค ๊ทผ์†Œํ•˜๊ฒŒ ๋†’๋‹ค).
translational shear์™€ slip
roll์— ์˜ํ•œ shear์™€ slip
cow(๋‹ค์ค‘ ์ ‘์ด‰ patch)
ํ”„๋กœ์ ํŠธ ํŽ˜์ด์ง€์˜ HydroShear ์‹œ๋ฎฌ๋ ˆ์ด์…˜ ์˜์ƒ(๋นจ๊ฐ„ ์ ์€ indenter ํ‘œ๋ฉด์ , ๋นจ๊ฐ„ ํ™”์‚ดํ‘œ๋Š” ํ‘œ๋ฉด์ ์˜ ์ถ”์  ๋ณ€์œ„, ์ดˆ๋ก ํ™”์‚ดํ‘œ๋Š” marker ๋ณ€์œ„). 1๋ฐฐ์†.

Fig. 6. ๋ณต์žกํ•œ ๊ธฐํ•˜(cow, ring torus)์˜ dilationยทshear๋ฅผ HydroShear, FOTS, TacSL๋กœ ์‹œ๋ฎฌ๋ ˆ์ด์…˜ํ•œ ๊ฒฐ๊ณผ. ์‹ค์ธก ์—ด์ด ์—†๋Š” ์ •์„ฑ ๋น„๊ต๋‹ค.

Fig. 6์€ SDF ๊ธฐ๋ฐ˜ ์ •์‹ํ™”๊ฐ€ ์—ฌ๋Ÿฌ ์ ‘์ด‰ patch๋ฅผ ๋‹ค๋ฃฐ ์ˆ˜ ์žˆ๋‹ค๋Š” ๊ฒƒ์„ ๋ณด์—ฌ ์ฃผ๋ ค๋Š” ๊ทธ๋ฆผ์ด์ง€๋งŒ, ์‹ค์ธก ground truth๊ฐ€ ์—†๋‹ค. โ€œ๋‹ค๋ฅธ ๋ฐฉ๋ฒ•๋ณด๋‹ค ํšจ๊ณผ์ ์œผ๋กœ ์‹œ๋ฎฌ๋ ˆ์ด์…˜ํ•œ๋‹คโ€๋Š” ์บก์…˜์˜ ์ฃผ์žฅ์„ ํŒ์ •ํ•  ๊ธฐ์ค€์ด ๊ทธ๋ฆผ ์•ˆ์— ์—†๋Š” ์…ˆ์ด๋‹ค. ์‹ค์ œ๋กœ torus shear์—์„œ FOTS์˜ field๋Š” ๋ฌผ์ฒด ์ „์ฒด๋ฅผ ํ•œ ๋ฉ์–ด๋ฆฌ๋กœ ๋Œ๊ณ , HydroShear๋Š” ๊ณ ๋ฆฌ ์•ˆ์ชฝ ๋นˆ ๊ณต๊ฐ„์˜ marker๋ฅผ ๊ฑฐ์˜ ์›€์ง์ด์ง€ ์•Š๋Š”๋ฐ, ์–ด๋А ์ชฝ์ด ์‹ค์ œ GelSight์— ๊ฐ€๊นŒ์šด์ง€๋Š” ์ธก์ •๋˜์ง€ ์•Š์•˜๋‹ค. ์ •๋Ÿ‰ ๊ฒ€์ฆ์€ sphere ํ•˜๋‚˜๋ฟ์ด๋‹ค.


Fig. 13. ํ‘œ๋ฉด์  ๋ฐ€๋„(surfel ์ง€๋ฆ„)์˜ ์˜ํ–ฅ. ์™ผ์ชฝ: ๋ณด์ • ๋ฐ์ดํ„ฐ ๋Œ€๋น„ RMSEยทCS, ์˜ค๋ฅธ์ชฝ: ๊ณ„์‚ฐ ์‹œ๊ฐ„๊ณผ ํ‘œ๋ฉด์  ์ˆ˜(๋กœ๊ทธ ์ถ•). ๋นจ๊ฐ„ ์ ์„ ์ด ์ฑ„ํƒ๊ฐ’ 1.5 mm.

๊ทธ๋ฆผ์—์„œ ์ฝ์œผ๋ฉด surfel ์ง€๋ฆ„์ด 5 mm๊นŒ์ง€๋Š” RMSEยทCS๊ฐ€ ๊ฑฐ์˜ ๊ทธ๋Œ€๋กœ์ด๊ณ , 10 mm ๊ทผ์ฒ˜๋ถ€ํ„ฐ CS๊ฐ€ 0.9 ์•„๋ž˜๋กœ ๋ฌด๋„ˆ์ง„๋‹ค. ๋ฐ˜๋Œ€๋กœ 1.5 mm๋ณด๋‹ค ๋” ์ด˜์ด˜ํ•˜๊ฒŒ ๊ฐ€๋ฉด ๊ณ„์‚ฐ ์‹œ๊ฐ„์ด ์ˆ˜ ์ดˆ ์ˆ˜์ค€์—์„œ ์ˆ˜๋ฐฑ ์ดˆ ์ˆ˜์ค€์œผ๋กœ ๋›ด๋‹ค. 1.5 mm๋Š” ์ •ํ™•๋„ ๊ณก์„ ์˜ ํ‰ํƒ„ํ•œ ๊ตฌ๊ฐ„ ๋์— ๊ฐ€๊นŒ์šด ์„ ํƒ์ด๋ผ, 3~5 mm๋กœ ํ‚ค์›Œ๋„ ์ •ํ™•๋„ ์†์‹ค์ด ์ž‘์„ ๊ฐ€๋Šฅ์„ฑ์ด ๊ทธ๋ฆผ์— ๋ณด์ธ๋‹ค. ์ €์ž๋“ค์€ ๊ทธ ์ง€์ ์„ ๋”ฐ๋กœ ๋…ผ์˜ํ•˜์ง€ ์•Š๋Š”๋‹ค.

์‹คํ—˜ 2: Zero-shot sim-to-real RL (ยงIV-B, Table II)

์‹ค์ œ ์…‹์—…

ํ•ญ๋ชฉ ๋‚ด์šฉ
๋กœ๋ด‡ 7-DoF Franka Emika Panda
์„ผ์„œ GelSight Mini ํ•œ ์Œ(์–‘ ์†๊ฐ€๋ฝ). shear ์ •์ฑ…์€ dotted gel, ์ด๋ฏธ์ง€ ์ •์ฑ…์€ non-dotted gel. ์‹ค์ œ shear๋Š” marker์˜ optical flow [px]
gripper PegยทBinยทBook์€ ๊ธฐ๋ณธ Franka hand, Drawer๋Š” grasp force๋ฅผ ๋” ์ •๋ฐ€ํ•˜๊ฒŒ ์กฐ์ ˆํ•˜๋Š” Weiss WSG-50
์‹œ๊ฐ ํ”ผ๋“œ๋ฐฑ ์—†์Œ
ํ‰๊ฐ€ ๊ณผ์ œ๋‹น ์ •์ฑ…๋งˆ๋‹ค 30ํšŒ

๋ณด์ •์— ์“ด KUKA์™€ ์ •์ฑ…์„ ๋Œ๋ฆฐ Franka๋Š” ๋‹ค๋ฅธ ๋กœ๋ด‡์ด๋‹ค. ๋ณด์ •์€ ์„ผ์„œ๋ฅผ ํ…Œ์ด๋ธ”์— ๊ณ ์ •ํ•˜๊ณ  KUKA๋กœ indenter๋ฅผ ์›€์ง์ด๋Š” ๋ณ„๋„ ์…‹์—…์—์„œ ํ–ˆ๋‹ค.

๊ณผ์ œ ๋…ธ๋ฆฌ๋Š” ์–ด๋ ค์›€ ์‹ค์ œ ํ‰๊ฐ€ ์กฐ๊ฑด
Peg Insertion ์† ์•ˆ ์ž์„ธ ๋ถˆํ™•์‹ค์„ฑ ์•„๋ž˜ ํž˜์ด ๋งŽ์ด ๋“œ๋Š” ์‚ฝ์ž… IndustReal ๋ณด๋“œ, ์›ํ†ต peg. ๋ชฉํ‘œ 3๊ณณ ร— ์† ์•ˆ ํšŒ์ „ 10๊ฐ€์ง€([-30^\circ,30^\circ]) = 30ํšŒ
Bin Packing ์‚ฝ์ž… ์ค‘ ๋‹ค์ค‘ ๋ฌผ์ฒด ์ƒํ˜ธ์ž‘์šฉ 15๊ฐœ cube๊ฐ€ ๋“  4ร—4 bin์˜ ์ง€์ • ์นธ์— ๋‚˜๋ฌด cube ์‚ฝ์ž…. ๋ชฉํ‘œ ์˜† cube 1~2๊ฐœ๊ฐ€ ๊ฐ€๋กœยท์„ธ๋กœ๋กœ ๋ฐ€๋ ค ๋ชฉํ‘œ๋ฅผ ์ผ๋ถ€ ๋˜๋Š” ํฌ๊ฒŒ ๊ฐ€๋ฆฐ๋‹ค
Book Shelving ์ค‘๋ ฅ์ด ์‚ฝ์ž…์ถ•๊ณผ ์ง๊ตํ•˜๋Š” ์ธก๋ฉด ์‚ฝ์ž…, ์†๊ฐ€๋ฝ๋ณด๋‹ค ํฐ ๋ฌผ์ฒด ์† ์•ˆ ์ž์„ธ๋Š” ์ผ์ •. ์ด์›ƒ ์ฑ…์ด ํ‰ํ–‰ ์ด๋™์ด๋‚˜ ๊ธฐ์šธ์ž„์œผ๋กœ ๋ชฉํ‘œ๋ฅผ ๊ฐ€๋ฆฐ๋‹ค. ํฌ๊ธฐ๊ฐ€ ๋‹ค๋ฅธ ์ฑ…๋“ค๋กœ๋„ ํ‰๊ฐ€
Drawer Pulling ๋ฏธ๋„๋Ÿฌ์ง ๊ฐ์ง€์™€ gripper ํญ ์—ฐ์† ์กฐ์ ˆ 7 mm ํญ์œผ๋กœ ๋А์Šจํ•˜๊ฒŒ ์ฅ๊ณ  ์‹œ์ž‘, ์ตœ์†Œ 4 mm๊นŒ์ง€ ์กฐ์ ˆ ๊ฐ€๋Šฅ. ์„œ๋ž ๋ฌด๊ฒŒ 3์ข…, ์™ธ๋ž€ ์œ„์น˜ยท์ง€์†์‹œ๊ฐ„ ๋ณ€ํ™”. ์†์žก์ด๋ฅผ ๋†“์น˜๋ฉด ์‹คํŒจ

Peg Insertion ์™ธ์—๋Š” 30ํšŒ๊ฐ€ ์–ด๋–ค ์กฐ๊ฑด ์กฐํ•ฉ์œผ๋กœ ๋‚˜๋‰˜์—ˆ๋Š”์ง€(์–ด๋–ค cube ๋ฐฐ์น˜๋ฅผ ๋ช‡ ๋ฒˆ, ์–ด๋–ค ์ฑ… ํฌ๊ธฐ๋ฅผ ๋ช‡ ๋ฒˆ, ๋ฌด๊ฒŒ๋ณ„๋กœ ๋ช‡ ๋ฒˆ) ๋…ผ๋ฌธ์— ์—†๋‹ค.


Fig. 7. ๊ณผ์ œ๋ณ„ ์‹œ๋ฎฌ๋ ˆ์ด์…˜ randomization. Peg: socket ์œ„์น˜์™€ peg์˜ ์† ์•ˆ ์ž์„ธ. Bin: 16์นธ ์ค‘ ๋ชฉํ‘œ, ๋ฐ€๋ฆฐ ์ •๋„ยท๋ฐฉํ–ฅ(๊ฐ€๋กœ/์„ธ๋กœ)ยท๋ฐ€๋ฆฐ cube ์ˆ˜(1/2). Book: ์ด์›ƒ ์ฑ…์„ ํ‰ํ–‰ ์ด๋™ํ•˜๊ฑฐ๋‚˜ ๊ธฐ์šธ์—ฌ ๋ชฉํ‘œ๋ฅผ ๊ฐ€๋ฆผ. Drawer: ์™ธ๋ž€์˜ ํฌ๊ธฐ์™€ ์‹œ์ .

๋น„๊ตํ•˜๋Š” ๋‹ค์„ฏ ์ •์ฑ…

๋‹ค์„ฏ ์ •์ฑ…์€ ๊ณผ์ œ๋งˆ๋‹ค ๊ฐ™์€ teacher critic checkpoint๋กœ AACD๋ฅผ ๋Œ๋ฆฌ๊ณ , ๋„คํŠธ์›Œํฌยท๊ด€์ธก ๊ตฌ์„ฑ(EE ์ž์„ธ, EE-๋ชฉํ‘œ ์ƒ๋Œ€ ์ž์„ธ, ์ด‰๊ฐ)์ด ๋ชจ๋‘ ๊ฐ™๋‹ค. ๋‹ค๋ฅธ ๊ฒƒ์€ ์ด‰๊ฐ ์‹œ๋ฎฌ๋ ˆ์ดํ„ฐ ํ•˜๋‚˜๋‹ค.

์ •์ฑ… ์ด‰๊ฐ ์ž…๋ ฅ ๋น„๊ณ 
TacSL Gray TacSL RGB ์ด‰๊ฐ ์ด๋ฏธ์ง€๋ฅผ grayscale๋กœ ์ €์ž๋“ค์ด ๊ฒฝํ—˜์ ์œผ๋กœ ์ž˜ ๋œ๋‹ค๊ณ  ํŒ๋‹จํ•ด grayscale ์‚ฌ์šฉ
TacSL Shear TacSL shear๋ฅผ per-taxel unit vector๋กœ ์ •๊ทœํ™” ์„ ํ–‰ ์—ฐ๊ตฌ๋“ค์˜ ๊ด€ํ–‰์„ ๋”ฐ๋ฆ„
FOTS ์› FOTS ์ •์‹ํ™” GPU ๋ณ‘๋ ฌํ™”๋งŒ ์ €์ž๊ฐ€ ์ƒˆ๋กœ ๊ตฌํ˜„
FOTS (Reimpl.) FOTS + ๊ธฐ์ค€์ ์„ ๋ฌผ์ฒด ์ค‘์‹ฌ ๋Œ€์‹  ์ดˆ๊ธฐ ์ ‘์ด‰ patch ์ค‘์‹ฌ์œผ๋กœ ์ €์ž ๊ฐœ๋Ÿ‰ํŒ. โ€œํ›จ์”ฌ ๊ฐ•ํ•œ ๋ฒ ์ด์Šค๋ผ์ธโ€์œผ๋กœ ์ œ์‹œ
HydroShear HydroShear shear field

FOTS ๊ณ„์—ด๊ณผ HydroShear์—๋Š” ์‹œ๋ฎฌ๋ ˆ์ด์…˜์—์„œ ์ค‘๋ ฅ ํšจ๊ณผ augmentation์„ ๋”ํ–ˆ๋‹ค(๋ถ€๋ก Gravity Effect). Isaac Gym์—์„œ๋Š” ์ฅ” ๋ฌผ์ฒด๊ฐ€ ๋‹ค๋ฅธ ๋ฌผ์ฒด์™€ ๋‹ฟ๊ธฐ ์ „๊นŒ์ง€ ์† ์•ˆ์—์„œ ์›€์ง์ด์ง€ ์•Š์•„ ์‹ค์ œ์—์„œ ์ค‘๋ ฅ์ด ๋งŒ๋“œ๋Š” shear๊ฐ€ ์ƒ๊ธฐ์ง€ ์•Š๋Š”๋‹ค. ๊ทธ๋ž˜์„œ ํ˜„์žฌ ์ž์„ธ์— ๋ณ€ํ™˜ {}^G\mathbf{X}^E๋ฅผ ๊ฐ€ํ•œ ์ž์„ธ๋กœ HydroShear๋ฅผ ํ•œ ๋ฒˆ ๋” ๋Œ๋ ค ์ค‘๋ ฅ shear \mathbf{g}_{j,t}๋ฅผ ์–ป๋˜, ๋‹ค์Œ ์Šคํ…์˜ ์žฌ๊ท€ ๊ณ„์‚ฐ์—๋Š” ์“ฐ์ง€ ์•Š๋Š”๋‹ค. TacSL ๋‘ ์ •์ฑ…์—๋Š” ์ด augmentation์ด ์–ธ๊ธ‰๋˜์ง€ ์•Š๋Š”๋‹ค.

๊ฒฐ๊ณผ

Table II. Zero-shot sim-to-real ์„ฑ๊ณต ํšŸ์ˆ˜.
์ •์ฑ… Peg Insertion Bin Packing Book Shelving Drawer Pulling Total
TacSL Gray 16/30 16/30 6/30 3/30 41/120
TacSL Shear 19/30 4/30 23/30 24/30 70/120
FOTS 1/30 5/30 20/30 15/30 41/120
FOTS (Reimpl.) 20/30 24/30 26/30 3/30 73/120
HydroShear 25/30 29/30 28/30 30/30 112/120

Fig. 18. HydroShear ์ •์ฑ…์˜ ์‹ค์ œ rollout keyframe. (a)~(c)๋Š” reset โ†’ ์ฒซ ์™ธ๋ถ€ ์ ‘์ด‰ โ†’ ์ ‘์ด‰์— ๋Œ€ํ•œ ๋ฐ˜์‘(repositionยทunsquish) โ†’ ์‚ฝ์ž… ์„ฑ๊ณต, (d)๋Š” reset โ†’ ์™ธ๋ž€ โ†’ grasp ์กฐ์ ˆ(๋นจ๊ฐ„ ํ…Œ๋‘๋ฆฌ) โ†’ ์„œ๋ž ์—ด๊ธฐ. ๊ฐ ๊ณผ์ œ ์•„๋ž˜ ์ค„์€ ๊ฐ™์€ ์‹œ์ ์˜ ์‹ค์ œ GelSight ์ด๋ฏธ์ง€(๋ณธ๋ฌธ ์„œ์ˆ ์ƒ marker ๋ณ€์œ„ ํ™”์‚ดํ‘œ๊ฐ€ ๊ฒน์ณ ์žˆ๋‹ค).
Peg Insertion
Bin Packing
Book Shelving
Drawer Pulling(์‚ฌ๋žŒ์ด ์„œ๋ž์„ ์žก์•„๋‹น๊ฒจ ์™ธ๋ž€์„ ์ค€๋‹ค)
ํ”„๋กœ์ ํŠธ ํŽ˜์ด์ง€์˜ HydroShear ์‹ค์ œ rollout ํ•˜์ด๋ผ์ดํŠธ(1๋ฐฐ์†). ํ”„๋กœ์ ํŠธ ํŽ˜์ด์ง€๊ฐ€ ๊ณ ๋ฅธ ์‚ฌ๋ก€๋‹ค.

๊ณผ์ œ๋ณ„ ํ•ด์„ (์ €์ž ์„ค๋ช…)

  • TacSL Gray๋Š” ์ ‘์ด‰ patch๊ฐ€ ์ž‘๊ณ  ๊ตญ์†Œ์ ์ธ PegยทBin์—์„œ๋Š” ์ค‘๊ฐ„ ์„ฑ๋Šฅ(16/30)์ด์ง€๋งŒ, ์ฑ…์ด ์†๊ฐ€๋ฝ๋ณด๋‹ค ์ปค์„œ elastomer ์ „์ฒด๊ฐ€ ๋ฎ์ด๋Š” Book Shelving(6/30)๊ณผ shear์˜ ๋ฐฉํ–ฅยท๋ˆ„์ ยทslip ๋‹จ์„œ๊ฐ€ ํ•„์š”ํ•œ Drawer Pulling(3/30)์—์„œ ๋ฌด๋„ˆ์ง„๋‹ค. ๋ถ€๋ก Fig. 16์—์„œ TacSL Gray์˜ ์ฑ… ์ด‰๊ฐ ์ด๋ฏธ์ง€๋Š” ๊ฑฐ์˜ ํŠน์ง•์ด ์—†๋‹ค.
  • TacSL Shear๋Š” ์ •๊ทœํ™”๊ฐ€ ์† ์•ˆ ์ž์„ธ ์ •๋ณด๋ฅผ ๋ณด์กดํ•˜๋Š” Peg(19/30)์™€ slip์ด ์ž์—ฐ์Šค๋Ÿฝ๊ฒŒ ๋“œ๋Ÿฌ๋‚˜๋Š” Drawer(24/30)์—์„œ๋Š” ๊ฐ•ํ•˜์ง€๋งŒ, ๋„“์€ patch์™€ ๋น„ํ‹€๋ฆผ์ด ์ƒ๊ธฐ๋Š” Bin Packing(4/30)์—์„œ ๋ฌด๋„ˆ์ง„๋‹ค.
  • ์› FOTS๋Š” ๋ฌผ์ฒด ์›์ ์ด ์ ‘์ด‰ patch์™€ ๋จผ Peg(1/30)ยทBin(5/30)์—์„œ ์‹คํŒจํ•˜๊ณ , ๊ฐ€๊นŒ์šด Book(20/30)ยทDrawer(15/30)์—์„œ๋Š” ๊ดœ์ฐฎ๋‹ค.
  • FOTS (Reimpl.) ์€ ๊ธฐ์ค€์ ์„ ์ดˆ๊ธฐ ์ ‘์ด‰ patch๋กœ ์˜ฎ๊ฒจ ์•ˆ์ •์  ์ ‘์ด‰ ๊ณผ์ œ๋ฅผ ํฌ๊ฒŒ ๊ฐœ์„ ํ•˜์ง€๋งŒ(Peg 20, Bin 24, Book 26), ์ ‘์ด‰์ด ์ž์ฃผ ๋ฐ”๋€Œ๋Š” Drawer(3/30)์—์„œ ๋ฌด๋„ˆ์ง„๋‹ค.
  • HydroShear๋Š” ๋„ค ๊ณผ์ œ ๋ชจ๋‘ 25/30 ์ด์ƒ์ด๋‹ค.

Fig. 17. Drawer Pulling์˜ ๊ฐ™์€ ์‹œ๋ฎฌ๋ ˆ์ด์…˜ rollout์„ ์‹œ๋ฎฌ๋ ˆ์ดํ„ฐ๋ณ„ ์ด‰๊ฐ์œผ๋กœ ๋ณธ keyframe. ์ €์ž ์„ค๋ช…์œผ๋กœ๋Š” ์†์žก์ด๊ฐ€ ๋ฏธ๋„๋Ÿฌ์ง€๊ธฐ ์‹œ์ž‘ํ•œ ๋’ค์—๋„ FOTS์˜ shear ํฌ๊ธฐ๋Š” ๊ณ„์† ์ปค์ง€๊ณ , HydroShear๋Š” slip์„ ๋ฐ˜์˜ํ•œ๋‹ค. TacSL Shear๋Š” ์ •๊ทœํ™”๋œ ์งง์€ ํ™”์‚ดํ‘œ๋งŒ ๋ณด์ธ๋‹ค.
๋‚˜๋จธ์ง€ ๊ณผ์ œ์˜ ์‹œ๋ฎฌ๋ ˆ์ด์…˜ rollout ๋น„๊ต (Fig. 14~16)

Fig. 14. Peg Insertion์˜ ๊ฐ™์€ rollout์— ๋Œ€ํ•œ ์‹œ๋ฎฌ๋ ˆ์ดํ„ฐ๋ณ„ ์ด‰๊ฐ keyframe.

Fig. 15. Bin Packing์˜ ๊ฐ™์€ rollout์— ๋Œ€ํ•œ ์‹œ๋ฎฌ๋ ˆ์ดํ„ฐ๋ณ„ ์ด‰๊ฐ keyframe.

Fig. 16. Book Shelving์˜ ๊ฐ™์€ rollout์— ๋Œ€ํ•œ ์‹œ๋ฎฌ๋ ˆ์ดํ„ฐ๋ณ„ ์ด‰๊ฐ keyframe. TacSL Gray ์ด๋ฏธ์ง€๋Š” ์ฑ…์ด elastomer ์ „์ฒด๋ฅผ ๋ฎ์–ด ํŠน์ง•์ด ๊ฑฐ์˜ ์—†๋‹ค.
HydroShear ์ •์ฑ…, ์‹ค์ œ GelSight ์˜์ƒ
FOTS (Reimpl.) ์ •์ฑ…, ์‹ค์ œ GelSight ์˜์ƒ
Drawer Pulling ์‹ค์ œ rollout์˜ ์ด‰๊ฐ ์˜์ƒ ๋น„๊ต. ํ”„๋กœ์ ํŠธ ํŽ˜์ด์ง€์˜ โ€œReal-World Rolloutsโ€ ์ ˆ์—์„œ ๊ฐ™์€ ๊ณผ์ œ์˜ ๋‘ ์ •์ฑ…์„ ๋‚˜๋ž€ํžˆ ๋‘” ๊ฒƒ์ด๋‹ค.

์„ฑ๊ณต๊นŒ์ง€ ๊ฑธ๋ฆฐ ์‹œ๊ฐ„ (๋ถ€๋ก Table IX)

Table IX. ์„ฑ๊ณต episode๋งŒ์˜ ํ‰๊ท  / ์ค‘์•™๊ฐ’ ์‹ค์ œ timestep(๋‚ฎ์„์ˆ˜๋ก ์ข‹์Œ). ๊ตต๊ฒŒ๋Š” ์› ํ‘œ์˜ ๊ฐ•์กฐ.
์ •์ฑ… Peg Insertion Bin Packing Book Shelving Drawer Pulling
TacSL Gray 76.9 / 74.0 96.9 / 89.5 178.2 / 176.5 63.7 / 63.0
TacSL Shear 87.1 / 81.0 97.7 / 91.0 99.4 / 93.0 155.6 / 125.0
FOTS 197.0 / 197.0 237.6 / 213.0 158.2 / 163.0 96.8 / 90.0
FOTS (Reimpl.) 74.9 / 73.5 169.2 / 148.5 126.7 / 114.0 75.7 / 72.0
HydroShear 85.2 / 82.0 108.8 / 86.0 180.2 / 182.5 120.6 / 116.5

HydroShear๋Š” ์–ด๋А ๊ณผ์ œ์—์„œ๋„ ๊ฐ€์žฅ ๋น ๋ฅด์ง€ ์•Š๊ณ , Book Shelving์—์„œ๋Š” ์„ฑ๊ณตํ•œ ์ •์ฑ… ์ค‘ ๊ฐ€์žฅ ๋А๋ฆฌ๋‹ค(180.2). ์„ฑ๊ณตํ•œ episode๋งŒ ํ‰๊ท ํ•œ ๊ฐ’์ด๋ผ ํ•ด์„์— ์ฃผ์˜๊ฐ€ ํ•„์š”ํ•˜๋‹ค. ์› FOTS Peg์˜ 197.0/197.0์€ ์„ฑ๊ณต 1ํšŒ์˜ ๊ฐ’์ด๊ณ , TacSL Gray Drawer 63.7์€ ์„ฑ๊ณต 3ํšŒ์˜ ๊ฐ’์ด๋‹ค. ๋” ์–ด๋ ค์šด ์ดˆ๊ธฐ ์กฐ๊ฑด๊นŒ์ง€ ์„ฑ๊ณตํ•˜๋Š” ์ •์ฑ…์ผ์ˆ˜๋ก ํ‰๊ท  ์‹œ๊ฐ„์ด ๋Š˜์–ด๋‚˜๋Š” ์„ ํƒ ํšจ๊ณผ๊ฐ€ ์žˆ์œผ๋ฏ€๋กœ, ์ด ํ‘œ๋Š” โ€œHydroShear ์ •์ฑ…์ด ๋А๋ฆฌ๋‹คโ€๋ณด๋‹ค โ€œ์„ฑ๊ณต๋ฅ  ์šฐ์œ„๊ฐ€ ์†๋„ ์šฐ์œ„๋กœ ์ด์–ด์ง€์ง€๋Š” ์•Š๋Š”๋‹คโ€ ์ •๋„๋กœ ์ฝ๋Š” ๊ฒƒ์ด ๋งž๋‹ค. timestep์˜ ์‹ค์ œ ์‹œ๊ฐ„ ๊ธธ์ด(์ œ์–ด ์ฃผ๊ธฐ)๋Š” ๋…ผ๋ฌธ์— ์—†๋‹ค.

Student ํ•™์Šต ๊ณก์„  (๋ถ€๋ก Fig. 9~12)


Fig. 9~12๋ฅผ 2ร—2๋กœ ํ•ฉ์„ฑ. ์™ผ์ชฝ ์œ„ Peg Insertion(Fig. 9), ์˜ค๋ฅธ์ชฝ ์œ„ Bin Packing(Fig. 10), ์™ผ์ชฝ ์•„๋ž˜ Book Shelving(Fig. 11), ์˜ค๋ฅธ์ชฝ ์•„๋ž˜ Drawer Pulling(Fig. 12). ์‹œ๋ฎฌ๋ ˆ์ด์…˜ ์•ˆ์˜ student ์„ฑ๊ณต๋ฅ ์ด๋‹ค.

๋ถ€๋ก์€ ์ด ๊ณก์„ ๋“ค์ด ๋ฐฉ๋ฒ• ๊ฐ„์— โ€œon parโ€๋ผ๊ณ  ์š”์•ฝํ•˜์ง€๋งŒ, ๊ณผ์ œ๋ณ„๋กœ ๋ณด๋ฉด ๊ทธ๋ ‡์ง€ ์•Š์€ ๊ณณ์ด ์žˆ๊ณ  ๊ทธ ์ฐจ์ด๊ฐ€ Table II์˜ ํ•ด์„์„ ๋ฐ”๊พผ๋‹ค.

  • Drawer Pulling์˜ FOTS (Reimpl.)์€ ์‹œ๋ฎฌ๋ ˆ์ด์…˜์—์„œ ํ•™์Šต ์ž์ฒด๊ฐ€ ์•ˆ ๋๋‹ค. ์„ฑ๊ณต๋ฅ ์ด 40M step ๋‚ด๋‚ด 0.01 ๊ทผ์ฒ˜๋‹ค(๊ทธ๋ฆผ์—์„œ ์ฝ์€ ๊ฐ’). ์‹ค์ œ 3/30์€ sim-to-real gap์ด ์•„๋‹ˆ๋ผ ํ•™์Šต ์‹คํŒจ์˜ ๊ฒฐ๊ณผ๋‹ค. ๋ณธ๋ฌธ์€ ์ด 3/30์„ โ€œ๋‹จ์ผ ๊ธฐ์ค€ patch ๊ฐ€์ •์ด ์ ‘์ด‰ ์ „ํ™˜ยทslipยท์™ธ๋ž€์—์„œ ๊นจ์ง„๋‹คโ€๋Š” sim-to-real ์‹คํŒจ๋กœ ์„ค๋ช…ํ•˜๋Š”๋ฐ, ํ•™์Šต ๊ณก์„ ์ด ๋ณด์—ฌ ์ฃผ๋Š” ๊ฒƒ์€ ๊ทธ ๊ฐ€์ •์ด ์‹œ๋ฎฌ๋ ˆ์ด์…˜ ์•ˆ์—์„œ๋ถ€ํ„ฐ ํ•™์Šต์„ ๋ง‰์•˜๋‹ค๋Š” ๊ฒƒ์ด๋‹ค.
  • ๊ฐ™์€ ๊ณผ์ œ์˜ ์› FOTS ๊ณก์„ ์€ ์•ฝ 13M step, ์„ฑ๊ณต๋ฅ  ์•ฝ 0.27์—์„œ ๋Š๊ธด๋‹ค. TacSL Shear๋Š” ์•ฝ 0.8๊นŒ์ง€ ์˜ฌ๋ž๋‹ค๊ฐ€ 40M์—์„œ ์•ฝ 0.43์œผ๋กœ ๋‚ด๋ ค๊ฐ„๋‹ค. ๊ทธ๋Ÿฐ๋ฐ ์‹ค์ œ ์„ฑ๊ณต์€ ๊ฐ๊ฐ 15/30(50%), 24/30(80%)๋กœ ์‹œ๋ฎฌ๋ ˆ์ด์…˜ ์ข…์ ๋ณด๋‹ค ๋†’๋‹ค. ์–ด๋А checkpoint๋ฅผ ๋ฐฐํฌํ–ˆ๋Š”์ง€ ๋…ผ๋ฌธ์— ์—†๊ณ , ์‹ค์ œ Drawer ํ‰๊ฐ€๊ฐ€ ์‹œ๋ฎฌ๋ ˆ์ด์…˜ randomization๋ณด๋‹ค ์‰ฌ์› ์„ ๊ฐ€๋Šฅ์„ฑ๋„ ๋ฐฐ์ œ๋˜์ง€ ์•Š๋Š”๋‹ค.
  • TacSL Gray๋Š” ๋ฐ˜๋Œ€๋‹ค. Drawer ์‹œ๋ฎฌ๋ ˆ์ด์…˜์—์„œ ์•ฝ 0.96์œผ๋กœ HydroShear์™€ ๊ฐ™์€ ์ˆ˜์ค€์ธ๋ฐ ์‹ค์ œ๋Š” 3/30์ด๋‹ค. ์ด๊ฒƒ์€ ์ง„์งœ sim-to-real gap์ด๋‹ค. Bin Packing์˜ TacSL Shear๋„ ์‹œ๋ฎฌ๋ ˆ์ด์…˜ ์•ฝ 0.93 โ†’ ์‹ค์ œ 4/30์œผ๋กœ ๊ฐ™์€ ๋ถ€๋ฅ˜๋‹ค.
  • Peg Insertion์—์„œ๋Š” HydroShear(์•ฝ 0.88)๊ฐ€ TacSL ShearยทFOTS (Reimpl.)(์•ฝ 0.90)์™€ ๋น„์Šทํ•˜๊ณ , TacSL Gray๋Š” ์•ฝ 0.70์ด๋‹ค.
  • Book Shelving ๊ณก์„ ์—๋Š” teacher ๊ณก์„ (Fig. 8)๊ณผ ๊ฐ™์€ ๋นˆ ์›โ†’์ฑ„์šด ์› ํ‘œ์‹œ์˜ ๊ธ‰๋ฝ์ด ๋ฐฉ๋ฒ•๋งˆ๋‹ค ๋‹ค๋ฅธ ์‹œ์ ์— ์žˆ๋‹ค. student๋Š” ์ด๋ฏธ fine-tuning๋œ teacher critic ํ•˜๋‚˜๋กœ ํ•™์Šตํ•œ๋‹ค๊ณ  ํ–ˆ์œผ๋ฏ€๋กœ ์ด ๊ธ‰๋ฝ์ด ๋ฌด์—‡์ธ์ง€ ๋ณธ๋ฌธ์— ์„ค๋ช…์ด ์—†๋‹ค.

์ •๋ฆฌํ•˜๋ฉด, โ€œstudent๋“ค์ด ์‹œ๋ฎฌ๋ ˆ์ด์…˜์—์„œ๋Š” ๋น„์Šทํ•˜์ง€๋งŒ ์‹ค์ œ์—์„œ ๊ฐˆ๋ฆฐ๋‹คโ€๋Š” ์„œ์‚ฌ๋Š” Bin Packing์˜ TacSL Shear, BookยทDrawer์˜ TacSL Gray์—๋Š” ๋งž๊ณ , Drawer Pulling์˜ FOTS ๋‘ ์ •์ฑ…์—๋Š” ๋งž์ง€ ์•Š๋Š”๋‹ค.

Contact penalty ablation

์ €์ž๋“ค์€ contact penalty๋กœ fine-tuningํ•œ teacher๊ฐ€ student์˜ ์‹ค์ œ ํ–‰๋™์„ ํฌ๊ฒŒ ๊ฐœ์„ ํ•œ๋‹ค๊ณ  ๋ณด๊ณ ํ•œ๋‹ค. penalty ์—†์ด ํ•™์Šตํ•œ Peg Insertion ์ •์ฑ…์€ socket๊ณผ ์ง€๋‚˜์น˜๊ฒŒ ์„ธ๊ฒŒ ๋ถ€๋”ชํžˆ๊ณ  ๊ฐ™์€ ๋ฐ˜์‘์„ ๋ฐ˜๋ณตํ•ด GelSight Mini์˜ elastomer๋ฅผ ์†์ƒ์‹œ์ผฐ๊ณ , penalty ์ปค๋ฆฌํ˜๋Ÿผ์„ ์“ฐ๋ฉด ํ†ต์ œ๋œ ์ ‘์ด‰๊ณผ emergentํ•œ ๋ชฉํ‘œ ํƒ์ƒ‰ ํ–‰๋™์ด ๋‚˜์™”๋‹ค๋Š” ๊ฒƒ์ด๋‹ค. ์ด ablation์€ ์ •์„ฑ ์„œ์ˆ ๋ฟ์ด๊ณ  ์„ฑ๊ณต๋ฅ ์ด๋‚˜ ์ ‘์ด‰๋ ฅ ์ˆ˜์น˜๋Š” ์—†๋‹ค.

์‹คํ—˜ 3: ๊ณ„์‚ฐ ์†๋„ (๋ถ€๋ก, Table XI)

Peg Insertion teacher rollout์—์„œ shear field๋ฅผ ๊ณ„์‚ฐํ•˜๋Š” ๋ฐ ๊ฑธ๋ฆฐ ์‹œ๊ฐ„์„ ํ™˜๊ฒฝ ์ˆ˜๋ณ„๋กœ ์Ÿ€๋‹ค.

Table XI. ํ™˜๊ฒฝ ์ˆ˜๋ณ„ shear ๊ณ„์‚ฐ ์‹œ๊ฐ„ [ms]. ์› ํ‘œ ํ—ค๋”์˜ โ€œStdev โ†‘โ€๋Š” ํ™”์‚ดํ‘œ ๋ฐฉํ–ฅ์ด ์˜๋ฏธ์ƒ ๋งž์ง€ ์•Š๋Š”๋‹ค.
๋ฐฉ๋ฒ• 256 env ํ‰๊ท  (std) 512 env 1024 env
FOTS 122.829 (3.445) 230.884 (6.360) 446.656 (4.028)
FOTS (Reimpl.) 11.145 (1.826) 11.827 (1.621) 12.040 (1.593)
HydroShear 33.805 (1.505) 57.042 (1.787) 103.736 (1.569)

HydroShear๋Š” ์› FOTS๋ณด๋‹ค 3.6~4.3๋ฐฐ ๋น ๋ฅด์ง€๋งŒ, ์ €์ž๋“ค์ด ๋ณ‘๋ ฌํ™”ํ•œ FOTS๋ณด๋‹ค๋Š” 256 env์—์„œ 3.0๋ฐฐ, 1024 env์—์„œ 8.6๋ฐฐ ๋А๋ฆฌ๋‹ค(ํ•„์ž ๊ณ„์‚ฐ). FOTS (Reimpl.)์€ ํ™˜๊ฒฝ ์ˆ˜๊ฐ€ 4๋ฐฐ๊ฐ€ ๋ผ๋„ ์•ฝ 1 ms๋งŒ ๋Š˜์–ด๋‚˜๋Š” ๋ฐ˜๋ฉด HydroShear๋Š” ๊ฑฐ์˜ ์„ ํ˜•์œผ๋กœ ๋Š˜์–ด๋‚œ๋‹ค. ์ €์ž๋“ค์€ ์ด ์ฆ๊ฐ€๊ฐ€ batched SDF ๊ณ„์‚ฐ์—์„œ ์˜จ๋‹ค๊ณ  ๋ณด๊ณ , ๋ช…๋ชฉ ๋ณต์žก๋„๋ฅผ FOTS์˜ O(N) ๋Œ€๋น„ O(N\times|K_t|)๋กœ ์ ๋Š”๋‹ค. ์ดˆ๋ก์˜ โ€œcomputationally efficientโ€๋Š” ์› FOTS๋‚˜ FEM๊ณผ ๋น„๊ตํ•  ๋•Œ์˜ ํ‘œํ˜„์ด๊ณ , ๊ฐ™์€ ์กฐ๊ฑด์˜ ๋ณ‘๋ ฌ ๊ตฌํ˜„๋ผ๋ฆฌ ๋น„๊ตํ•˜๋ฉด HydroShear๊ฐ€ ๋” ๋น„์‹ธ๋‹ค. 1024 env์—์„œ ์Šคํ…๋งˆ๋‹ค ์•ฝ 0.1 s๊ฐ€ ์ถ”๊ฐ€๋˜๋Š” ์…ˆ์ธ๋ฐ, ์ด๊ฒƒ์ด PPO ํ•™์Šต ์ „์ฒด wall-clock์—์„œ ์–ด๋А ์ •๋„ ๋น„์ค‘์ธ์ง€๋Š” ๋ณด๊ณ ๋˜์ง€ ์•Š๋Š”๋‹ค.

ํ—ค๋“œ๋ผ์ธ ์ˆ˜์น˜ ๊ฒ€์‚ฐ

์ดˆ๋ก๊ณผ ์„œ๋ก ์˜ ์ˆ˜์น˜๋ฅผ Table II๋กœ ๋˜๊ณ„์‚ฐํ–ˆ๋‹ค.

๋ฌธ์žฅ ์ถœ์ฒ˜ Table II๋กœ ๊ณ„์‚ฐํ•œ ๊ฐ’ ํŒ์ •
โ€œ93% average success rateโ€ ์ดˆ๋ก 112/120 = 93.3% ์ผ์น˜
โ€œtactile images (34%)โ€ ์ดˆ๋ก TacSL Gray 41/120 = 34.2% ์ผ์น˜. ๋‹จ ์› FOTS shear ์ •์ฑ…๋„ 41/120 = 34.2%
โ€œalternative shear simulation methods (58%โ€“61%)โ€ ์ดˆ๋ก TacSL Shear 58.3%, FOTS (Reimpl.) 60.8% ๋ฒ”์œ„์—์„œ ์› FOTS(34.2%)๊ฐ€ ๋น ์ ธ ์žˆ๋‹ค
โ€œ32% increase compared to the best performing baselineโ€ ยงI 93.3 โˆ’ 60.8 = 32.5 %p percentage point๋‹ค. ์ƒ๋Œ€ ์ฆ๊ฐ€์œจ๋กœ๋Š” 53.4%

์ดˆ๋ก์˜ โ€œ์ด๋ฏธ์ง€ 34% vs shear ์‹œ๋ฎฌ๋ ˆ์ดํ„ฐ 58~61%โ€ ๊ตฌ๋„๋Š” โ€œ์ด๋ฏธ์ง€ ์ •์ฑ… < shear ์ •์ฑ…โ€์œผ๋กœ ์ฝํžˆ์ง€๋งŒ, ์› FOTS shear ์ •์ฑ…์€ ์ด๋ฏธ์ง€ ์ •์ฑ…๊ณผ ์ •ํ™•ํžˆ ๊ฐ™์€ 41/120์ด๋‹ค. shear๋ผ๋Š” ๊ด€์ธก ํ˜•์‹์ด ์•„๋‹ˆ๋ผ shear๋ฅผ ์–ด๋–ป๊ฒŒ ์‹œ๋ฎฌ๋ ˆ์ด์…˜ํ•˜๋А๋ƒ๊ฐ€ ๊ฒฐ์ •์ ์ด๋ผ๋Š” ๊ฒƒ์ด ์ด ๋…ผ๋ฌธ์˜ ์ฃผ์žฅ์ด๋ฏ€๋กœ, ์˜คํžˆ๋ ค ์› FOTS๋ฅผ ๋ฒ”์œ„์— ๋„ฃ๋Š” ํŽธ์ด ๋…ผ์ง€๋ฅผ ๋” ์ž˜ ๋ฐ›์นœ๋‹ค.

โ€œ32%โ€ ๊ฒฉ์ฐจ์˜ ๊ตฌ์„ฑ๋„ ๋ณผ ํ•„์š”๊ฐ€ ์žˆ๋‹ค. ๋ฒ ์ด์Šค๋ผ์ธ ํ•ฉ๊ณ„ 1์œ„์ธ FOTS (Reimpl.)์˜ 73/120์—๋Š” ์‹œ๋ฎฌ๋ ˆ์ด์…˜์—์„œ ํ•™์Šต์ด ์•ˆ ๋œ Drawer 3/30์ด ๋“ค์–ด ์žˆ๋‹ค. ๋ช‡ ๊ฐ€์ง€ ๋‹ค๋ฅธ ๊ธฐ์ค€์œผ๋กœ ๋‹ค์‹œ ๊ณ„์‚ฐํ•˜๋ฉด ๋‹ค์Œ๊ณผ ๊ฐ™๋‹ค(๋ชจ๋‘ ํ•„์ž ๊ณ„์‚ฐ).

๋น„๊ต ๊ธฐ์ค€ HydroShear ๋ฒ ์ด์Šค๋ผ์ธ ์ฐจ์ด
ํ•ฉ๊ณ„ 1์œ„ ๋ฒ ์ด์Šค๋ผ์ธ FOTS (Reimpl.), 4๊ณผ์ œ 112/120 (93.3%) 73/120 (60.8%) 32.5 %p
๊ฐ™์€ ๋น„๊ต์—์„œ Drawer ์ œ์™ธ, 3๊ณผ์ œ 82/90 (91.1%) 70/90 (77.8%) 13.3 %p
๊ณผ์ œ๋งˆ๋‹ค ๊ทธ ๊ณผ์ œ์˜ ์ตœ๊ณ  ๋ฒ ์ด์Šค๋ผ์ธ์„ ๊ณ ๋ฅธ ํ•ฉ์„ฑ ์˜ค๋ผํด(20+24+26+24) 112/120 (93.3%) 94/120 (78.3%) 15.0 %p

๊ณผ์ œ๋งˆ๋‹ค ๊ฐ€์žฅ ์ž˜ํ•œ ๋ฒ ์ด์Šค๋ผ์ธ๊ณผ ์ผ๋Œ€์ผ๋กœ ๋น„๊ตํ•˜๋ฉด, 30ํšŒ ํ‘œ๋ณธ์—์„œ ์ฐจ์ด๊ฐ€ ํ†ต๊ณ„์ ์œผ๋กœ ๋šœ๋ ทํ•œ ๊ฒƒ์€ Drawer Pulling ํ•˜๋‚˜๋‹ค.

์‹ ๋ขฐ๊ตฌ๊ฐ„์€ Wilson 95%, p๋Š” 2ร—2 Fisher exact(ํ•„์ž ๊ณ„์‚ฐ).
๊ณผ์ œ HydroShear ๊ทธ ๊ณผ์ œ์˜ ์ตœ๊ณ  ๋ฒ ์ด์Šค๋ผ์ธ Fisher exact ์–‘์ธก p
Peg Insertion 25/30 (95% CI 66~93%) FOTS (Reimpl.) 20/30 (49~81%) 0.23
Bin Packing 29/30 (83~99%) FOTS (Reimpl.) 24/30 (63~91%) 0.10
Book Shelving 28/30 (79~98%) FOTS (Reimpl.) 26/30 (70~95%) 0.67
Drawer Pulling 30/30 (89~100%) TacSL Shear 24/30 (63~91%) 0.024

HydroShear๊ฐ€ ๋„ค ๊ณผ์ œ ๋ชจ๋‘์—์„œ ์ตœ๊ณ ์ด๊ณ  ์–ด๋А ๊ณผ์ œ์—์„œ๋„ ๋ฌด๋„ˆ์ง€์ง€ ์•Š๋Š”๋‹ค๋Š” ๊ฒƒ์ด ์ด ์‹คํ—˜์˜ ๊ฐ€์žฅ ๋‹จ๋‹จํ•œ ๊ฒฐ๊ณผ๋‹ค. ๋ฒ ์ด์Šค๋ผ์ธ์€ ๋ชจ๋‘ ์ ์–ด๋„ ํ•œ ๊ณผ์ œ์—์„œ 30ํšŒ ์ค‘ 6ํšŒ ์ดํ•˜๋กœ ๋ฌด๋„ˆ์ง„๋‹ค. ๋ฐ˜๋ฉด โ€œ๊ณผ์ œ X์—์„œ HydroShear๊ฐ€ ์ตœ์„ ์˜ ๋Œ€์•ˆ๋ณด๋‹ค ๋‚ซ๋‹คโ€๋Š” ๊ณผ์ œ๋ณ„ ์ฃผ์žฅ์€ Drawer ์™ธ์—๋Š” ์ด ํ‘œ๋ณธ ํฌ๊ธฐ๋กœ ํ™•์ •๋˜์ง€ ์•Š๋Š”๋‹ค. ์‹œ๋“œ ์ˆ˜๋‚˜ ๋ฐ˜๋ณต ํ•™์Šต์— ๋Œ€ํ•œ ์–ธ๊ธ‰๋„ ์—†์–ด, ๊ฐ ์นธ์ด ์ •์ฑ… ํ•˜๋‚˜๋ฅผ 30ํšŒ ๋Œ๋ฆฐ ๊ฒฐ๊ณผ๋กœ ๋ณด์ธ๋‹ค.

์ €์ž๊ฐ€ ๋ฐํžŒ ํ•œ๊ณ„ (ยงV)

  • ๋ฌผ๋ฆฌ ์—”์ง„์ด ์นจํˆฌ๋ฅผ ํ—ˆ์šฉํ•˜๋Š” ์ ‘์ด‰์„ ์ง€์›ํ•ด์•ผ ํ•œ๋‹ค. ์ด ๋…ผ๋ฌธ์€ Isaac Gym TacSL์˜ Kelvin-Voigt compliant contact ๊ตฌํ˜„์— ์˜์กดํ•œ๋‹ค. hydroelastic ์ ‘์ด‰์„ ๊ธฐ๋ณธ ์ง€์›ํ•˜๋Š” ์—”์ง„์œผ๋กœ ํ™•์žฅํ•˜๋Š” ๊ฒƒ์ด ํ–ฅํ›„ ๊ณผ์ œ๋‹ค.
  • SDF ํ•ด์ƒ๋„๋ฅผ ๋†’์ด๋ฉด ์ •ํ™•๋„๊ฐ€ ์˜ค๋ฅด์ง€๋งŒ ์ถ”์ ํ•  ์ ์ด ๋Š˜์–ด ๋А๋ ค์ง„๋‹ค. SDF๋Š” rigid body์— ํŠนํžˆ ์ ํ•ฉํ•˜๊ณ , ๋ณ€ํ˜•์ฒด๋Š” ๋‹ค๋ฅธ ํ‘œํ˜„๊ณผ ์ถ”์ ยทํž˜ ๊ณ„์‚ฐ ์•Œ๊ณ ๋ฆฌ์ฆ˜์ด ํ•„์š”ํ•˜๋‹ค.
  • elastomer๊ฐ€ ํ‰ํ‰ํ•˜๋‹ค๊ณ  ๊ฐ€์ •ํ•œ๋‹ค. dexterous hand ์†๋์˜ ๊ณก๋ฉด elastomer๋กœ์˜ ํ™•์žฅ์€ ํ–ฅํ›„ ๊ณผ์ œ๋‹ค.
  • ๋ณ€ํ˜• ๋‹จ์„œ์— ์˜์กดํ•˜๋Š” vision-based ์ด‰๊ฐ ์„ผ์„œ์— ํšจ๊ณผ์ ์ด๋ฉฐ, ๋‹ค๋ฅธ ์ด‰๊ฐ ์„ผ์„œ๋กœ์˜ ํ™•์žฅ์€ ํ‰๊ฐ€ ๋ฒ”์œ„ ๋ฐ–์ด๋‹ค.

๊ณต๊ฐœ ์ฝ”๋“œ์™€ ๋Œ€์กฐ (์ •์  ํ™•์ธ)

๊ณต์‹ ์ฝ”๋“œ(MIT)๋ฅผ ์ฝ์–ด ๋…ผ๋ฌธ๊ณผ ๋งž์ถฐ ๋ณธ ๊ฒฐ๊ณผ๋‹ค. ํ•™์Šต์ด๋‚˜ ์‹œ๋ฎฌ๋ ˆ์ด์…˜์€ ๋Œ๋ฆฌ์ง€ ์•Š์•˜๋‹ค.

  • ํ•ต์‹ฌ์€ ๋‘ ๋ฉ”์„œ๋“œ๋‹ค. ๊ฒฝ๋กœ ์˜์กด ํž˜ ์ถ”์ (Coulomb clipping๊ณผ ์ ‘์ด‰ ์ดํƒˆ reset ํฌํ•จ)๊ณผ marker shear ๊ณ„์‚ฐ์ด ๊ฐ๊ฐ ํ•œ ํ•จ์ˆ˜์— ๋“ค์–ด ์žˆ๊ณ , dilation์€ ๋ณ„๋„ ๊ตฌ๊ฐ„์ด๋‹ค. ์„ผ์„œ ํด๋ž˜์Šค๋Š” ์„ ํ–‰ ์—ฐ๊ตฌ(FOTS)์˜ ์ด๋ฆ„์„ ๊ทธ๋Œ€๋กœ ์“ด๋‹ค.
  • Eq. 6์˜ ๋ถ€ํ˜ธ์™€ 0/0. ์‹์„ ๋ฌธ์ž ๊ทธ๋Œ€๋กœ ๊ณ„์‚ฐํ•˜๋ฉด ๋‘ ์‹œ์  ๋ชจ๋‘ elastomer ์•ˆ์ผ ๋•Œ \alpha=-1์ด ๋‚˜์˜จ๋‹ค. ์ฝ”๋“œ๋Š” \alpha์™€ ๋ณ€์œ„ ๋ฐฉํ–ฅ์„ ํ•จ๊ป˜ ๋’ค์ง‘์–ด ๊ฒฐ๊ณผ \mathbf{d}๋Š” ๊ฐ™๋‹ค. ๋‹ค๋งŒ SDF ๊ฐ’์ด ๋ณ€ํ•˜์ง€ ์•Š๋Š” ์ˆœ์ˆ˜ ์ ‘์„  ๋ฏธ๋„๋Ÿผ(ํ‰ํ‰ํ•œ elastomer์—์„œ shear๊ฐ€ ์ƒ๊ธฐ๋Š” ๋ฐ”๋กœ ๊ทธ ๊ฒฝ์šฐ)์€ Eq. 6์ด 0/0์ด ๋˜๋Š”๋ฐ, ์ฝ”๋“œ๋Š” โ€œ์•ˆ์ด๋ฉด 1, ๋ฐ–์ด๋ฉด 0โ€์œผ๋กœ ๋ฉ”์šด๋‹ค. ๋…ผ๋ฌธ์—๋Š” ์ด ๊ทœ์น™์ด ์—†๋‹ค.
  • ๋‹จ์ผ tracker ๋‹จ์ˆœํ™”(E=K=A=1). ์ถ”์ ๋˜๋Š” ๊ฐ’์€ ์‚ฌ์‹ค์ƒ ๋ฏธํ„ฐ ๋‹จ์œ„ ๋ณ€์œ„๋‹ค.
  • ๋ณด์ • ๊ฐ’์€ ์„ค์ • ํŒŒ์ผ์—๋งŒ ์žˆ๋‹ค. ๋…ผ๋ฌธ์ด ์‹ฃ์ง€ ์•Š์€ \mu, \lambda_d, \lambda_s, K๊ฐ€ sensor yaml์— ์žˆ๊ณ (์•„๋ž˜ ๋น„ํŒ 4๋ฒˆ), Drawer ๊ณผ์ œ๋Š” \mu์™€ \lambda_s๋ฅผ ๋”ฐ๋กœ ๋ฎ์–ด์“ด๋‹ค. ๋ณด์ • ์ฝ”๋“œ์™€ ์‹ค์ธก ๋ฐ์ดํ„ฐ๋Š” ๊ณต๊ฐœ๋ผ ์žˆ์ง€ ์•Š๋‹ค.
  • AACD๋Š” ๋ณ„๋„ distillation loss๊ฐ€ ์•„๋‹ˆ๋‹ค. student๊ฐ€ teacher์˜ critic(๊ฐ€์ค‘์น˜, optimizer, ํ•™์Šต๋ฅ , ์ •๊ทœํ™” ํ†ต๊ณ„)๋งŒ ๋ถˆ๋Ÿฌ์˜ค๋Š” PPO๋‹ค.
  • ๋…ผ๋ฌธ ํ‘œ์™€ ์„ค์ •์ด ๋‹ค๋ฅธ ๊ณณ. peg์˜ stage 2 \lambda_{\text{contact}}์™€ \alpha_{\text{centered}}, student์˜ ํ•™์Šต๋ฅ ยทminibatch, ํ–‰๋™ ์ฐจ์›(gain์„ ์ •์ฑ…์ด ์ถœ๋ ฅํ•˜์ง€ ์•Š๊ณ  ๋ฌด์ž‘์œ„ํ™”), ์ด‰๊ฐ ๊ด€์ธก ์ฑ„๋„ ์ˆ˜๊ฐ€ ๋…ผ๋ฌธ Table๊ณผ ๋‹ค๋ฅด๋‹ค. README์˜ ์ผ๋ถ€ ๋ช…๋ น์€ ๊ทธ๋Œ€๋กœ๋Š” ์„ค์ • ์กฐํ•ฉ์— ์‹คํŒจํ•œ๋‹ค.
  • ๊ณต๊ฐœ ๋ฒ”์œ„. 4๊ฐœ ๊ณผ์ œ ํ™˜๊ฒฝ, teacher ํ•™์Šต, student, ๋ฒ ์ด์Šค๋ผ์ธ(TacSL, FOTS)์€ ์žˆ๋‹ค. ์‹ค๋กœ๋ด‡ ๋ฐฐํฌ, Table IยทXI ํ‰๊ฐ€ ์Šคํฌ๋ฆฝํŠธ, ๋ณด์ • ์ ˆ์ฐจ๋Š” ์—†๋‹ค. ์ฒดํฌํฌ์ธํŠธ๋Š” peg insertion์˜ teacher์™€ student๋ฟ์ด๋‹ค.

๋น„ํŒ์ ์œผ๋กœ ๋ณด๋ฉด

๊ฐ•์ 

  • shear๋ฅผ ์ด๋ ฅ์˜ ํ•จ์ˆ˜๋กœ ์ •์˜ํ•œ ๊ฒƒ ์ž์ฒด๊ฐ€ ๊ธฐ์—ฌ๋‹ค. stick, slip, hysteresis, ๋ฆฌ์…‹์ด โ€œ๋ณ€์œ„ ๋ˆ„์  + Coulomb clipping + Heavisideโ€ ์„ธ ์ค„์—์„œ ํ•จ๊ป˜ ๋‚˜์˜ค๊ณ , ๋ณ„๋„์˜ ์ƒํƒœ ๊ธฐ๊ณ„๋‚˜ ํŒ์ • ๊ทœ์น™์ด ์—†๋‹ค. ํ‘œ๋ฉด์  ๋‹จ์œ„๋ผ SE(3) ํšŒ์ „๊ณผ rolling๋„ ๋”ฐ๋กœ ๋ชจ๋ธ๋งํ•˜์ง€ ์•Š๊ณ  ์ž์—ฐ์Šค๋Ÿฝ๊ฒŒ ๋“ค์–ด์˜จ๋‹ค. ํŒŒ๋ผ๋ฏธํ„ฐ๊ฐ€ 4๊ฐœ๋ฟ์ด๋ผ ๋ณด์ •์ด ๊ฐ€๋ณ๋‹ค.
  • ๋ฒ ์ด์Šค๋ผ์ธ์„ ์„ฑ์‹คํ•˜๊ฒŒ ๊ฐ•ํ™”ํ–ˆ๋‹ค. ์› FOTS๋ฅผ GPU ๋ณ‘๋ ฌ๋กœ ๋‹ค์‹œ ๊ตฌํ˜„ํ–ˆ์„ ๋ฟ ์•„๋‹ˆ๋ผ ๊ธฐ์ค€์  ๋ฌธ์ œ๋ฅผ ๊ณ ์นœ ๊ฐœ๋Ÿ‰ํŒ๊นŒ์ง€ ๋งŒ๋“ค์–ด ๋น„๊ตํ–ˆ๋‹ค. ๊ฐœ๋Ÿ‰ํŒ์ด ์›ํŒ๋ณด๋‹ค 32ํšŒ ๋” ์„ฑ๊ณต(41 โ†’ 73)ํ–ˆ๋‹ค๋Š” ๊ฒƒ์€ ๊ทธ๋งŒํผ ๊ฐ•ํ•œ ๋ฒ ์ด์Šค๋ผ์ธ์ด๋ผ๋Š” ๋œป์ด๊ณ , ๊ทธ๊ฒƒ์„ ๋„˜์—ˆ๋‹ค๋Š” ์ ์—์„œ ๊ฒฐ๊ณผ์˜ ๋ฌด๊ฒŒ๊ฐ€ ์ปค์ง„๋‹ค.
  • ๋น„๊ต์˜ ํ†ต์ œ๊ฐ€ ๊น”๋”ํ•˜๋‹ค. ๊ณผ์ œ๋งˆ๋‹ค teacher critic์„ ํ•˜๋‚˜๋กœ ๊ณ ์ •ํ•˜๊ณ  ๋„คํŠธ์›Œํฌยท๊ด€์ธก์„ ๋งž์ถฐ โ€œ์ด‰๊ฐ ์‹œ๋ฎฌ๋ ˆ์ดํ„ฐ๋งŒ ๋ฐ”๊พผโ€ ๋น„๊ต๊ฐ€ ๋๋‹ค.
  • ๊ณผ์ œ ์„ค๊ณ„๊ฐ€ ๊ฐ ์‹คํŒจ ๋ชจ๋“œ๋ฅผ ๊ฒจ๋ƒฅํ•œ๋‹ค. ์† ์•ˆ ์ž์„ธ(Peg), ๋‹ค์ค‘ ์ ‘์ด‰(Bin), ์ „๋ฉด ์ ‘์ด‰(Book), slip(Drawer)์ด ๊ฐ๊ฐ ๋‹ค๋ฅธ ๋ฒ ์ด์Šค๋ผ์ธ์˜ ์•ฝ์ ์„ ๋“œ๋Ÿฌ๋‚ด๊ณ , Table II์˜ ํŒจํ„ด์ด ๊ทธ ์„ค๊ณ„ ์˜๋„์™€ ๊ฑฐ์˜ ๊ทธ๋Œ€๋กœ ๋งž์•„๋–จ์–ด์ง„๋‹ค.
  • ์ž๊ธฐ ๋ฐฉ๋ฒ•์— ๋ถˆ๋ฆฌํ•œ ๊ฒฐ๊ณผ๋ฅผ ์ˆจ๊ธฐ์ง€ ์•Š์•˜๋‹ค. ๋ณ‘๋ ฌ FOTS๋ณด๋‹ค ๋А๋ฆฌ๋‹ค๋Š” ์†๋„ํ‘œ, ์„ฑ๊ณต๊นŒ์ง€ ์‹œ๊ฐ„์ด ๊ฐ€์žฅ ๋น ๋ฅด์ง€ ์•Š๋‹ค๋Š” Table IX, ์‹œ๋ฎฌ๋ ˆ์ด์…˜ ํ•™์Šต ๊ณก์„ ์ด ๋น„์Šทํ•˜๋‹ค๋Š” ์„œ์ˆ ์„ ๋ชจ๋‘ ๋ถ€๋ก์— ์‹ค์—ˆ๋‹ค.
  • ์ฝ”๋“œ๊ฐ€ MIT ๋ผ์ด์„ ์Šค๋กœ ๊ณต๊ฐœ๋ผ ์žˆ๋‹ค(์œ„ โ€œ๊ณต๊ฐœ ์ฝ”๋“œ์™€ ๋Œ€์กฐโ€ ์ ˆ).

์•ฝ์ ยทํ•œ๊ณ„

  1. Table II์˜ ๊ฒฉ์ฐจ๋Š” ๊ณผ์ œ๋ณ„๋กœ ๋ณด๋ฉด ํ‘œ๋ณธ ํฌ๊ธฐ ์•ˆ์— ์žˆ๋‹ค. ๊ณผ์ œ๋‹น 30ํšŒ, ์ •์ฑ… 1๊ฐœ(์‹œ๋“œ ์–ธ๊ธ‰ ์—†์Œ)๋กœ๋Š” PegยทBinยทBook์—์„œ HydroShear์™€ ์ตœ๊ณ  ๋ฒ ์ด์Šค๋ผ์ธ์˜ ์ฐจ์ด๊ฐ€ ์œ ์˜ํ•˜์ง€ ์•Š๋‹ค(p = 0.23, 0.10, 0.67). ํ—ค๋“œ๋ผ์ธ 32.5 %p ์ค‘ ์ ˆ๋ฐ˜ ์ด์ƒ์€ Drawer ํ•œ ๊ณผ์ œ์—์„œ ๋‚˜์˜ค๊ณ , ๊ทธ ๊ณผ์ œ์˜ ๋น„๊ต ์ƒ๋Œ€ FOTS (Reimpl.)์€ ์‹œ๋ฎฌ๋ ˆ์ด์…˜์—์„œ ํ•™์Šตํ•˜์ง€ ๋ชปํ•œ ์ •์ฑ…์ด๋‹ค. ๊ณผ์ œ๋‹น ์—ฌ๋Ÿฌ ์‹œ๋“œ์™€ ๋” ๋งŽ์€ trial์ด ์žˆ์—ˆ๋‹ค๋ฉด ์ฃผ์žฅ์ด ํ›จ์”ฌ ๋‹จ๋‹จํ•ด์กŒ์„ ๊ฒƒ์ด๋‹ค.
  2. โ€œsim-to-real gapโ€๊ณผ โ€œ์‹œ๋ฎฌ๋ ˆ์ด์…˜ ํ•™์Šต ์‹คํŒจโ€๊ฐ€ ๊ตฌ๋ถ„๋˜์ง€ ์•Š๋Š”๋‹ค. ๋ถ€๋ก Fig. 12๋Š” Drawer์˜ FOTS (Reimpl.)์ด ์‹œ๋ฎฌ๋ ˆ์ด์…˜์—์„œ ๊ฑฐ์˜ 0์ด๋ผ๋Š” ๊ฒƒ์„ ๋ณด์—ฌ ์ฃผ๋Š”๋ฐ, ๋ณธ๋ฌธ์€ ๊ทธ ์‹ค์ œ 3/30์„ sim-to-real ์‹คํŒจ๋กœ ์„ค๋ช…ํ•œ๋‹ค. ๋ฐฐํฌ checkpoint ์„ ํƒ ๊ธฐ์ค€๋„ ์—†์–ด์„œ, ์‹œ๋ฎฌ๋ ˆ์ด์…˜ ์ข…์ ๋ณด๋‹ค ์‹ค์ œ ์„ฑ๊ณต๋ฅ ์ด ๋†’์€ ์ •์ฑ…(์› FOTS, TacSL Shear์˜ Drawer)์„ ํ•ด์„ํ•  ๊ทผ๊ฑฐ๊ฐ€ ์—†๋‹ค. ํ‘œ์— ์‹œ๋ฎฌ๋ ˆ์ด์…˜ ์„ฑ๊ณต๋ฅ  ์—ด์„ ํ•จ๊ป˜ ๋‘์—ˆ๋‹ค๋ฉด gap์„ ์ง์ ‘ ์ฝ์„ ์ˆ˜ ์žˆ์—ˆ๋‹ค.
  3. shear ์ถฉ์‹ค๋„ ๊ฒ€์ฆ์ด sphere ํ•˜๋‚˜๋ฟ์ด๋‹ค. Table I์˜ 70์ƒ˜ํ”Œ(๋ณด์ • 30 + ๊ฒ€์ฆ 40)์€ ๋ชจ๋‘ 35 mm sphere๋‹ค. ์ •์ฑ… ๊ณผ์ œ์˜ peg, cube, ์ฑ…, ์†์žก์ด๋Š” ํ‰๋ฉด ๋ชจ์„œ๋ฆฌ์™€ ๋„“์€ ๋ฉด ์ ‘์ด‰์ด ํ•ต์‹ฌ์ธ๋ฐ, ๊ทธ ๊ธฐํ•˜์—์„œ shear ์ •ํ™•๋„๋ฅผ ์žฐ ์‹ค์ธก์€ ์—†๋‹ค. Fig. 6์˜ cowยทtorus๋Š” ์‹ค์ธก ์—ด์ด ์—†๋Š” ์‹œ๋ฎฌ๋ ˆ์ดํ„ฐ ๊ฐ„ ๋น„๊ต๋ผ โ€œ๋” ์ •ํ™•ํ•˜๋‹คโ€๋Š” ํŒ์ •์„ ๋‚ด๋ฆด ์ˆ˜ ์—†๋‹ค.
  4. ๋ณด์ • ๊ฒฐ๊ณผ์™€ ๋ณด์ • ์ ˆ์ฐจ๊ฐ€ ์™„์ „ํžˆ ๋ณด๊ณ ๋˜์ง€ ์•Š์•˜๋‹ค. ๋ณด์ •๋œ (\lambda_d,\lambda_s,K,\mu) ๊ฐ’์ด ์—†๊ณ , \lambda_s์™€ K๋ฅผ ๋”ฐ๋กœ ๋งž์ถ”๋Š”์ง€ ํ•จ๊ป˜ ๋งž์ถ”๋Š”์ง€๊ฐ€ ยงIII-Cยท๋ถ€๋ก๊ณผ ยงIV-A์—์„œ ๋‹ค๋ฅด๊ฒŒ ์ ํ˜€ ์žˆ๋‹ค. ๋ณด์ • ๋ฐ์ดํ„ฐ๊ฐ€ ๊ฐ 10์ƒ˜ํ”Œ๋กœ ์ž‘์€๋ฐ, ๋ณด์ •๊ฐ’์˜ ๋ถ„์‚ฐ์ด๋‚˜ ์„ผ์„œ ๊ฐœ์ฒด ๊ฐ„ ์ฐจ์ด๋„ ๋‹ค๋ฃจ์ง€ ์•Š๋Š”๋‹ค.
  5. ๋ชจ๋ธ ๊ฐ€์ •์ด ๊ฐ•ํ•˜๊ณ  ๊ทธ ์˜ํ–ฅ์ด ์ธก์ •๋˜์ง€ ์•Š์•˜๋‹ค. E=K(๋ฒ•์„ ยท์ ‘์„  ๊ฐ•์„ฑ ๋™์ผ), ํ‘œ๋ฉด์  ๋ฉด์  ๊ท ์ผ, ํ‰ํ‰ํ•œ elastomer, ๊ฐ•์„ฑ์˜ ์„ ํ˜•์„ฑ์ด ๋ชจ๋‘ ๊ฐ€์ •์ด๋‹ค. ๋‹จ์ผ ์ถ”์ ๊ธฐ๋กœ ์ค„์ด๋Š” E=K ๊ฐ€์ •์€ ๊ณ„์‚ฐ์„ ๋ฐ˜์œผ๋กœ ์ค„์ด์ง€๋งŒ, ์ด ๊ฐ€์ •์„ ํ’€์—ˆ์„ ๋•Œ ์ •ํ™•๋„๊ฐ€ ์–ผ๋งˆ๋‚˜ ๋‹ฌ๋ผ์ง€๋Š”์ง€๋Š” ์—†๋‹ค. ์ €์ž๋“ค์ด ์†Œ๊ฐœ์—์„œ โ€œhydroelastic pressure field ๋ชจ๋ธ์˜ ํ™•์žฅโ€์ด๋ผ ๋ถ€๋ฅด์ง€๋งŒ ์‹ค์ œ ์‹์€ ์  ๋‹จ์œ„ ์„ ํ˜• ์Šคํ”„๋ง ๋ˆ„์ ์ด๋ผ๋Š” ์ ๋„ ๋…์ž๊ฐ€ ์•Œ๊ณ  ์ฝ์„ ํ•„์š”๊ฐ€ ์žˆ๋‹ค.
  6. ์‹ ํ‘œ๊ธฐ์— ์ผ๊ด€์„ฑ ๋ฌธ์ œ๊ฐ€ ์žˆ๋‹ค. \alpha^d ์˜ค๊ธฐ, ์ถ”์  ๋ณ€์œ„ \hat{\mathbf{f}}์™€ ํˆฌ์˜์  \hat{\mathbf{o}}์˜ ๋ถ€ํ˜ธ ๊ทœ์•ฝ(์œ„ callout), Drawer ๋ณด์ƒ์˜ r_{\text{perturb}} ์กฐ๊ฑด์‹์ด ์„ค๋ช…๊ณผ ๋ฐ˜๋Œ€๋กœ ์ฝํžˆ๋Š” ์ , MDP ํ‘œ์˜ shear ์ฑ„๋„ ์ˆ˜(3 vs 2), ๊ฐ•์„ฑ K์™€ ์ ‘์ด‰ ์ง‘ํ•ฉ K_t์˜ ๊ธฐํ˜ธ ์ค‘๋ณต์ด ์žˆ๋‹ค. ํ•˜๋‚˜ํ•˜๋‚˜๋Š” ์‚ฌ์†Œํ•˜์ง€๋งŒ, ๋ฐฉ๋ฒ• ์ ˆ์˜ ์‹๋งŒ์œผ๋กœ ๊ตฌํ˜„์„ ์žฌํ˜„ํ•˜๋ ค๋Š” ๋…์ž์—๊ฒŒ๋Š” ๊ฑธ๋ฆผ๋Œ์ด๋‹ค.
  7. ๋ฒ ์ด์Šค๋ผ์ธ ๊ฐ„ ํ•˜๋“œ์›จ์–ดยท์ฒ˜๋ฆฌ ์กฐ๊ฑด์ด ์™„์ „ํžˆ ๊ฐ™์ง€๋Š” ์•Š๋‹ค. ์ด๋ฏธ์ง€ ์ •์ฑ…์€ non-dotted gel, shear ์ •์ฑ…์€ dotted gel๋กœ ์‹ค์ œ ์„ผ์„œ๊ฐ€ ๋‹ค๋ฅด๋‹ค. ์ค‘๋ ฅ augmentation์€ FOTS ๊ณ„์—ด๊ณผ HydroShear์—๋งŒ ์ ์šฉ๋๋‹ค๊ณ  ์ ํ˜€ ์žˆ๊ณ  TacSL ๋‘ ์ •์ฑ…์—๋Š” ์–ธ๊ธ‰์ด ์—†๋‹ค. Book Shelving์—์„œ TacSL Gray๊ฐ€ 6/30์œผ๋กœ ๋ฌด๋„ˆ์ง„ ์›์ธ ์ค‘ ์ผ๋ถ€๊ฐ€ ์ด‰๊ฐ ์‹œ๋ฎฌ๋ ˆ์ดํ„ฐ๊ฐ€ ์•„๋‹ˆ๋ผ ์ด๋Ÿฐ ์กฐ๊ฑด ์ฐจ์ด์ผ ๊ฐ€๋Šฅ์„ฑ์€ ๋ถ„๋ฆฌ๋˜์ง€ ์•Š์•˜๋‹ค.
  8. โ€œcomputationally efficientโ€๋Š” ๋น„๊ต ๋Œ€์ƒ์— ๋”ฐ๋ผ ๋‹ค๋ฅด๋‹ค. ์› FOTS๋ณด๋‹ค๋Š” 4๋ฐฐ ๋น ๋ฅด์ง€๋งŒ ๋ณ‘๋ ฌํ™”ํ•œ FOTS๋ณด๋‹ค๋Š” 3~9๋ฐฐ ๋А๋ฆฌ๊ณ , ํ™˜๊ฒฝ ์ˆ˜์— ๊ฑฐ์˜ ์„ ํ˜•์œผ๋กœ ๋Š˜์–ด๋‚œ๋‹ค. Fig. 13์„ ๋ณด๋ฉด surfel์„ 3~5 mm๋กœ ํ‚ค์›Œ๋„ ์ •ํ™•๋„ ์†์‹ค์ด ์ž‘์„ ์ˆ˜ ์žˆ์–ด ์†๋„๋ฅผ ํšŒ์ˆ˜ํ•  ์—ฌ์ง€๊ฐ€ ์žˆ๋Š”๋ฐ, ์ด trade-off๊ฐ€ ์ •์ฑ… ์„ฑ๊ณต๋ฅ ์— ๋ฏธ์น˜๋Š” ์˜ํ–ฅ์€ ์‹คํ—˜๋˜์ง€ ์•Š์•˜๋‹ค.
  9. Contact penalty ์ปค๋ฆฌํ˜๋Ÿผ์˜ ํšจ๊ณผ๋Š” ์ •์„ฑ ์„œ์ˆ ๋ฟ์ด๋‹ค. โ€œ์„ผ์„œ๋ฅผ ์ฐข์ง€ ์•Š๊ฒŒ ํ•œ๋‹คโ€๋Š” ์‹ค์šฉ์ ์œผ๋กœ ์ค‘์š”ํ•œ ์ฃผ์žฅ์ธ๋ฐ ์ˆ˜์น˜๊ฐ€ ์—†๋‹ค. ์ปค๋ฆฌํ˜๋Ÿผ์ด student ์„ฑ๊ณต๋ฅ ์— ๊ธฐ์—ฌํ•˜๋Š” ์ •๋„์™€ HydroShear์˜ ๊ธฐ์—ฌ๋ฅผ ๋ถ„๋ฆฌํ•  ์ˆ˜ ์—†๋‹ค.
  10. ์ œ3์ž ๋น„๊ต์—์„œ๋Š” ๊ฒฐ๊ณผ๊ฐ€ ๋‹ค๋ฅด๊ฒŒ ๋‚˜์˜จ ์‚ฌ๋ก€๊ฐ€ ์žˆ๋‹ค. HydroShear๋ฅผ ๊ธฐ๋ฐ˜์œผ๋กœ ์••์ถ•์„ฑ ํ•ญ๊ณผ clamped ๊ฒฝ๊ณ„์กฐ๊ฑด์„ ๋”ํ•œ Tactile Genesis์˜ Fig. 2(์ƒ๋Œ€ RMSE, ์šฐ๋ฆฌ ๋ฆฌ๋ทฐ์— ์˜ฎ๊ธด ๊ฐ’)์—์„œ shear ์˜ค์ฐจ๋Š” FOTS 0.210, HydroShear 0.217๋กœ HydroShear๊ฐ€ FOTS๋ณด๋‹ค ๊ทผ์†Œํ•˜๊ฒŒ ๋†’๊ณ , dilation์€ 0.514 vs 0.403์œผ๋กœ HydroShear๊ฐ€ ๋‚ฎ๋‹ค. ์ง€ํ‘œยท๋ฐ์ดํ„ฐยท๊ตฌํ˜„์ด ์ด ๋…ผ๋ฌธ๊ณผ ๋‹ฌ๋ผ ์ง์ ‘ ๋น„๊ตํ•  ์ˆ˜๋Š” ์—†์ง€๋งŒ, translational shear์—์„œ ๋‘ ๋ฐฉ๋ฒ•์˜ ์ฐจ์ด๊ฐ€ ์ž‘๋‹ค๋Š” Table I์˜ ๊ด€์ฐฐ๊ณผ๋Š” ๋ฐฉํ–ฅ์ด ๋งž๋Š”๋‹ค. HydroShear์˜ ์šฐ์œ„๋Š” twistยทrollยท์ ‘์ด‰ ์ „ํ™˜์— ์ง‘์ค‘๋ผ ์žˆ๋‹ค๊ณ  ๋ณด๋Š” ํŽธ์ด ์•ˆ์ „ํ•˜๋‹ค.

๊ด€๋ จ ์—ฐ๊ตฌ์™€์˜ ์ž๋ฆฌ ๋งค๊น€

HydroShear๋Š” ์ด‰๊ฐ ์‹œ๋ฎฌ๋ ˆ์ด์…˜์˜ โ€œ๋น ๋ฅธ ๊ทผ์‚ฌโ€ ๊ณ„์—ด์—์„œ shear์˜ ๋™์—ญํ•™์„ ๋‹ค๋ฃฌ ์ž‘์—…์œผ๋กœ ์ž๋ฆฌ ์žก๋Š”๋‹ค. ๊ฐ™์€ ๊ณ„์—ด์˜ TACTO์™€ TacSL์€ ์ด๋ฏธ์ง€ยท์ ‘์ด‰๋ ฅ์—, FOTS์™€ ์ด๋ฅผ marker ์‹œ๋ฎฌ๋ ˆ์ด์…˜์— ์“ด TacEx๋Š” marker ๋ณ€์œ„์˜ ์šด๋™ํ•™์— ์ง‘์ค‘ํ–ˆ๋‹ค. HydroShear๋Š” FOTS์˜ dilation ์‹๊ณผ Gaussian shadowing์„ ๊ทธ๋Œ€๋กœ ๋ฌผ๋ ค๋ฐ›๊ณ , ๊ธฐ์ค€์  ํ•˜๋‚˜๋ฅผ ํ‘œ๋ฉด์  ์ˆ˜์ฒœ ๊ฐœ์˜ ์ด๋ ฅ์œผ๋กœ ๋ฐ”๊ฟจ๋‹ค. FEM ๊ณ„์—ด(TaCauchy, DiffTactile)์ด ์—ฐ์†์ฒด ์—ญํ•™์œผ๋กœ ์–ป๋Š” ๊ฒฝ๋กœ ์˜์กด์„ฑ์„, ํ‘œ๋ฉด์  ๋‹จ์œ„์˜ 1์ฐจ ๊ทผ์‚ฌ๋กœ RL ๊ทœ๋ชจ์—์„œ ์“ธ ์ˆ˜ ์žˆ๊ฒŒ ๋งŒ๋“  ์…ˆ์ด๋‹ค.

shear๋ฅผ sim-to-real์˜ ํ•ต์‹ฌ์œผ๋กœ ๋ณธ ๋‹ค๋ฅธ ์‹œ๋„๋กœ๋Š” TactileLab์ด ์žˆ๊ณ , hydroelastic ์ ‘์ด‰ ์ž์ฒด๋ฅผ GPU์—์„œ SDF๋กœ ๊ณ„์‚ฐํ•˜๋Š” ์ •์‹ํ™”๋Š” GPU-Accelerated Hydroelastic Contact์—์„œ ๋ณผ ์ˆ˜ ์žˆ๋‹ค. HydroShear๊ฐ€ ํ•œ๊ณ„๋กœ ๋“  โ€œ์นจํˆฌ๋ฅผ ํ—ˆ์šฉํ•˜๋Š” ์—”์ง„ ์˜์กดโ€์€ ์ด๋Ÿฐ hydroelastic ์—”์ง„์ด ์„ฑ์ˆ™ํ•˜๋ฉด ํ’€๋ฆด ์ˆ˜ ์žˆ๋Š” ๋ฌธ์ œ๋‹ค.

HydroShear ์ดํ›„์˜ ํ๋ฆ„๋„ ์ด๋ฏธ ์žˆ๋‹ค. Tactile Genesis์˜ ElastomerTaxel์€ HydroShear๋ฅผ ๊ธฐ๋ฐ˜์œผ๋กœ ์••์ถ•์„ฑ๊ณผ ๊ฒฝ๊ณ„์กฐ๊ฑด์„ ์ถ”๊ฐ€ํ–ˆ๊ณ , ์—ฌ๋Ÿฌ ์ด‰๊ฐ ์ถ”์ƒ ์ค‘ ํ•˜๋‚˜๋กœ ํ†ตํ•ฉํ–ˆ๋‹ค. RL ์ชฝ์—์„œ๋Š” TacSL์˜ AACD๋ฅผ ๊ทธ๋Œ€๋กœ ์“ฐ๋Š”๋ฐ, privileged teacher์—์„œ ์ด‰๊ฐ student๋กœ ์˜ฎ๊ธฐ๋Š” ๋ฐฉ๋ฒ•๋ก  ์ž์ฒด๋Š” PTLD๋‚˜ Which Taxels์ฒ˜๋Ÿผ DAggerยทlatent distillation์„ ์“ฐ๋Š” ์ž‘์—…๋“ค๊ณผ ๋น„๊ตํ•ด ๋ณผ ๋งŒํ•˜๋‹ค. ์ด ๋…ผ๋ฌธ์€ student ํ•™์Šต ๋ฐฉ์‹์€ ๊ณ ์ •ํ•˜๊ณ  ์ด‰๊ฐ ์‹œ๋ฎฌ๋ ˆ์ดํ„ฐ๋งŒ ๋ฐ”๊ฟจ์œผ๋ฏ€๋กœ, distillation ๋ฐฉ์‹๊ณผ ์‹œ๋ฎฌ๋ ˆ์ดํ„ฐ ์ถฉ์‹ค๋„์˜ ์ƒํ˜ธ์ž‘์šฉ์€ ์—ด๋ฆฐ ์งˆ๋ฌธ์œผ๋กœ ๋‚จ๋Š”๋‹ค.

์š”์•ฝ

HydroShear๋Š” tactile shear๋ฅผ โ€œํ˜„์žฌ ์นจํˆฌโ€๊ฐ€ ์•„๋‹ˆ๋ผ โ€œ์ ‘์ด‰ ํ›„ ๊ฒฝ๋กœโ€์˜ ํ•จ์ˆ˜๋กœ ์ •์˜ํ•˜๊ณ , ์ด๋ฅผ indenter ํ‘œ๋ฉด์ ๋งˆ๋‹ค ๋ณ€์œ„๋ฅผ ๋ˆ„์ ํ•˜๊ณ  Coulomb cone์œผ๋กœ ์ž๋ฅด๋Š” ์žฌ๊ท€์‹์œผ๋กœ ๊ตฌํ˜„ํ–ˆ๋‹ค. ํŒŒ๋ผ๋ฏธํ„ฐ 4๊ฐœ๋ฅผ ๋‹จ๊ณ„๋ณ„๋กœ ๋ณด์ •ํ•˜๋ฉด sphere ์‹ค์ธก์—์„œ twistยทroll์„ ํฌํ•จํ•œ ๋ชจ๋“  ์œ ํ˜•์˜ shear๋ฅผ FOTSยทTacSL๋ณด๋‹ค ์ •ํ™•ํ•˜๊ฒŒ ์žฌํ˜„ํ•˜๊ณ (ํ‰๊ท  CS 0.951 vs 0.788 vs 0.186), ์ด shear๋กœ ํ•™์Šตํ•œ ์ •์ฑ…์€ Franka Panda์˜ 4๊ฐœ ๊ณผ์ œ์—์„œ 112/120์œผ๋กœ ์„ฑ๊ณตํ–ˆ๋‹ค.

๊ฐ€์žฅ ๋‹จ๋‹จํ•œ ๊ฒฐ๊ณผ๋Š” โ€œHydroShear๋งŒ์ด ๋„ค ๊ณผ์ œ ๋ชจ๋‘์—์„œ ๋ฌด๋„ˆ์ง€์ง€ ์•Š๋Š”๋‹คโ€๋Š” ๊ฒƒ์ด๋‹ค. ๋‹ค๋ฅธ ๋ชจ๋“  ๋ฒ ์ด์Šค๋ผ์ธ์€ ์ ์–ด๋„ ํ•œ ๊ณผ์ œ์—์„œ 30ํšŒ ์ค‘ 6ํšŒ ์ดํ•˜๋กœ ๋–จ์–ด์ง„๋‹ค. ๋ฐ˜๋ฉด ๊ณผ์ œ๋ณ„ ์šฐ์œ„๋Š” ๋Œ€๋ถ€๋ถ„ 30ํšŒ ํ‘œ๋ณธ์˜ ์‹ ๋ขฐ๊ตฌ๊ฐ„ ์•ˆ์— ์žˆ๊ณ , ํ—ค๋“œ๋ผ์ธ ๊ฒฉ์ฐจ์˜ ์ƒ๋‹น ๋ถ€๋ถ„์€ ์‹œ๋ฎฌ๋ ˆ์ด์…˜์—์„œ ํ•™์Šต๋˜์ง€ ์•Š์€ ๋ฒ ์ด์Šค๋ผ์ธ๊ณผ์˜ Drawer ๋น„๊ต์—์„œ ๋‚˜์˜จ๋‹ค. ๋ณด์ •๊ฐ’ ๋ฏธ๋ณด๊ณ , sphere ์™ธ ๊ธฐํ•˜์˜ ์‹ค์ธก ๊ฒ€์ฆ ๋ถ€์žฌ, ์‹ ํ‘œ๊ธฐ์˜ ๋ถ€ํ˜ธ ํ”๋“ค๋ฆผ๋„ ์žฌํ˜„ํ•˜๋ ค๋Š” ๋…์ž๊ฐ€ ์•Œ์•„๋‘˜ ์ง€์ ์ด๋‹ค. ๊ทธ๋ž˜๋„ โ€œ์ •๊ทœํ™”๋‚˜ ์ด๋ฏธ์ง€๋กœ ์šฐํšŒํ•˜์ง€ ๋ง๊ณ  shear๋ฅผ ๋ฌผ๋ฆฌ์ ์œผ๋กœ ๋งž์ถฐ๋ผโ€๋Š” ๋ฉ”์‹œ์ง€๋ฅผ ๊ฐ•ํ•œ ๋ฒ ์ด์Šค๋ผ์ธ๊ณผ ๋‹ค์–‘ํ•œ ์‹คํŒจ ๋ชจ๋“œ์˜ ๊ณผ์ œ๋กœ ๋ณด์—ฌ ์ค€ ์ž‘์—…์ด๊ณ , ๊ณก๋ฉด elastomer์™€ ๋ณ€ํ˜•์ฒด๋กœ์˜ ํ™•์žฅ, ๊ทธ๋ฆฌ๊ณ  ๋” ํฐ ํ‘œ๋ณธ์˜ ์žฌ๊ฒ€์ฆ์ด ๋‹ค์Œ ๋‹จ๊ณ„๋‹ค.

์ด ๊ธ€์— ๋Œ€ํ•ด

  • ์ฝ์€ ๋ฒ”์œ„: arXiv v2(2603.00446v2)์˜ LaTeX ์†Œ์Šค์™€ PDF. ๋ณธ๋ฌธ๊ณผ ๋ถ€๋ก์˜ ๋ชจ๋“  ํ‘œ(Table I~XI)๋ฅผ ํ™•์ธํ–ˆ๊ณ , ๊ฒฐ๊ณผยทํ•˜์ดํผํŒŒ๋ผ๋ฏธํ„ฐ ํ‘œ๋Š” ์› ํ‘œ์˜ ์ˆซ์ž๋ฅผ ๊ทธ๋Œ€๋กœ ๋งˆํฌ๋‹ค์šด์œผ๋กœ ์˜ฎ๊ฒผ๋‹ค(Table III~VI์˜ MDP ๊ตฌ์„ฑ์€ ๋ณธ๋ฌธ ์„œ์ˆ ๋กœ ์š”์•ฝํ–ˆ๋‹ค). ๊ทธ๋ฆผ์€ Fig. 1~18 ์ „๋ถ€๋ฅผ ์‹ค์—ˆ๊ณ  Fig. 9~12๋Š” ํ•œ ์žฅ์œผ๋กœ ํ•ฉ์„ฑํ–ˆ๋‹ค. ์˜์ƒ์€ ํ”„๋กœ์ ํŠธ ํŽ˜์ด์ง€์˜ ๊ฒƒ์ด๋‹ค.
  • ์ฝ”๋“œ: ๊ณต์‹ ์ฝ”๋“œ๊ฐ€ MIT ๋ผ์ด์„ ์Šค๋กœ ๊ณต๊ฐœ๋ผ ์žˆ๋‹ค. ๋ณธ๋ฌธ์€ ๋…ผ๋ฌธ์„ ๊ทผ๊ฑฐ๋กœ ์ผ๊ณ , โ€œ๊ณต๊ฐœ ์ฝ”๋“œ์™€ ๋Œ€์กฐโ€ ์ ˆ๋งŒ ์ฝ”๋“œ๋ฅผ ์ •์ ์œผ๋กœ ์ฝ์–ด ํ™•์ธํ•œ ๋‚ด์šฉ์ด๋‹ค(์‹คํ–‰์€ ํ•˜์ง€ ์•Š์•˜๋‹ค).
  • ํ‘œ๊ธฐ: โ€œํ•„์ž ๊ณ„์‚ฐโ€์€ ๋…ผ๋ฌธ ์ˆ˜์น˜๋กœ ์ง์ ‘ ๊ณ„์‚ฐํ•œ ๊ฐ’(ํ‰๊ท , ๋น„์œจ, Wilson 95% ์‹ ๋ขฐ๊ตฌ๊ฐ„, Fisher exact p)์ด๋‹ค. โ€œ๊ทธ๋ฆผ์—์„œ ์ฝ์€ ๊ฐ’โ€์€ ํ•™์Šต ๊ณก์„ ๊ณผ Fig. 13์—์„œ ๋ˆˆ์œผ๋กœ ์ฝ์€ ๊ทผ์‚ฌ๊ฐ’์ด๋‹ค. โ€œํ•„์ž ํ•ด์„โ€์€ ๋…ผ๋ฌธ์ด ๋ช…์‹œํ•˜์ง€ ์•Š์€ ํ•ด์„์ด๋‹ค(๋ถ€ํ˜ธ ๊ทœ์•ฝ ๋ฉ”๋ชจ, Fig. 13์˜ surfel ํฌ๊ธฐ ์—ฌ์ง€, ํ•™์Šต ๊ณก์„ ๊ณผ Table II๋ฅผ ์—ฎ์€ ํ•ด์„). ์ธ์šฉ ๋ฌธํ—Œ์€ ๋ฒˆํ˜ธ ๋Œ€์‹  ์ด๋ฆ„์œผ๋กœ ์ ์—ˆ๋‹ค.
  • ๊ด€๋ จ ์ž๋ฃŒ: Amazon Science ๋ธ”๋กœ๊ทธ์— ์ด ๋…ผ๋ฌธ์„ ์†Œ๊ฐœํ•˜๋Š” ๊ธ€์ด ์žˆ๋‹ค. ์ด ๊ธ€์˜ ์ˆ˜์น˜์™€ ์‹คํ—˜ ์กฐ๊ฑด์€ ๋ชจ๋‘ ๋…ผ๋ฌธ ์›๋ฌธ์„ ๊ธฐ์ค€์œผ๋กœ ํ–ˆ๋‹ค.

Copyright 2026, JungYeon Lee