Curieux.JY
  • JungYeon Lee
  • Post
  • ๐Ÿ•ธ๏ธ Graph
  • Lecture
  • Note

On this page

  • ๐Ÿ” Ping Review
  • ๐Ÿ”” Ring Review
    • ํ•œ ์ค„๋กœ ์‹œ์ž‘ํ•˜๋ฉด
    • ์™œ ์–ด๋ ค์šด๊ฐ€: โ€œ๋ณด๊ธฐ ์ข‹์€ ์ด๋ฏธ์ง€โ€์™€ โ€œ๋ฏฟ์„ ํž˜โ€ ์‚ฌ์ด
    • ๋ฐฉ๋ฒ• ์ƒ์„ธ
      • 1) ๋ฉ”์‹œ: contact-aware ์ ์‘ ์„ธ๋ถ„ํ™”
      • 2) ๊ตฌ์„ฑ๋ฒ•์น™๊ณผ UIPC ์†”๋ฒ„
      • 3) Cauchy ์‘๋ ฅ ์ถ”์ถœ๊ณผ traction ๋ถ„ํ•ด (ํ•ต์‹ฌ ๊ธฐ์—ฌ)
      • 4) ๋ฌผ๋ฆฌ ์ œ์•ฝ ๊ด‘ํ•™ ๋ Œ๋”๋ง
    • ์ง๊ด€: ์™œ โ€œ์‘๋ ฅ์„ ๋จผ์ €โ€๊ฐ€ ์ด๋“์ธ๊ฐ€
    • ์‹คํ—˜
      • ์…‹์—…๊ณผ ์„ฑ๋Šฅ
      • ๋ฌผ๋ฆฌ ๊ฒ€์ฆ: ์‹ค๋ฌผ ๋Œ€๋น„ SSIM 0.93+
      • ์ ‘์ด‰ ๋ชจ๋“œ ๋ถ„์„: ํž˜์žฅ์ด ๋ฌผ๋ฆฌ๋ฅผ ๋“œ๋Ÿฌ๋‚ด๋Š”๊ฐ€
      • ๋‹ค์ค‘ ์„ผ์„œ ํ™•์žฅ์„ฑ
    • ๋น„ํŒ์ ์œผ๋กœ ๋ณด๋ฉด
      • ๊ฐ•์ 
      • ์•ฝ์ ยทํ•œ๊ณ„
    • ๊ด€๋ จ ์—ฐ๊ตฌ์™€์˜ ์ž๋ฆฌ ๋งค๊น€
    • ์š”์•ฝ

๐Ÿ“ƒTaCauchy ๋ฆฌ๋ทฐ

tactile
visuo-tactile
simulation
fem
contact
sim2real
GelSight
DIGIT
IsaacSim
TaCauchy: An Extensible FEM Framework for Vision-Based Tactile Simulation
Published

June 21, 2026

  • Paper Link (arXiv:2606.20426) โ€” ์ด ๋ฆฌ๋ทฐ๋Š” v1 (2026-06-18, arXiv ๋น„๋…์  ๋ผ์ด์„ ์Šค) ๊ธฐ์ค€์ด๋ฉฐ, ์ˆ˜์น˜๋Š” ์ „๋ถ€ ์›๋ฌธ์—์„œ ํ™•์ธํ•œ ๊ฐ’์ด๋‹ค.

  • Code Link (github.com/figsama/TaCauchy) โ€” MIT. TacEx ์ฝ”๋“œ๋ฒ ์ด์Šค๋ฅผ ํ™•์žฅํ•œ Isaac Lab ์ต์Šคํ…์…˜ ํ˜•ํƒœ๋กœ ์ „์ฒด ๊ณต๊ฐœ๋ผ ์žˆ๋‹ค(REPRODUCTION.md ์„ค์น˜ยท์žฌํ˜„ ๊ฐ€์ด๋“œ, Docker, Git LFS ์—์…‹, --sensor gelsight|digit|9dtact ๋ฐ๋ชจยท๋ฒค์น˜๋งˆํฌ ์Šคํฌ๋ฆฝํŠธ, Isaac Lab RL ํƒœ์Šคํฌ ํฌํ•จ). 2026-08-31 ํ™•์ธ ์‹œ์  ์ตœ์‹  ํ‘ธ์‹œ๋Š” 2026-07-21.

  • Hengfei Zhao, Yifan Xie, Junhao Gong, Yue Sun, Kai Zhu, Weihua He, Shoujie Li, Haohuan Fu, Wenbo Ding (Tsinghua SIGS ยท Huawei)

  • IEEE/RSJ IROS 2026 ์ฑ„ํƒ (arXiv v1 2026-06-18, cs.RO)

  1. ๐Ÿ’ก TaCauchy๋Š” vision-based ์ด‰๊ฐ ์„ผ์„œ ์‹œ๋ฎฌ๋ ˆ์ด์…˜์ด โ€œ๊ทธ๋Ÿด๋“ฏํ•œ ์ด๋ฏธ์ง€๋Š” ๋งŒ๋“ค์–ด๋„ ์‹ ๋ขฐํ•  ํž˜ ์ •๋ณด๋Š” ๋ชป ์ค€๋‹คโ€๋Š” ๋ฌธ์ œ๋ฅผ, ํ•˜์ดํผํƒ„์„ฑ ๊ตฌ์„ฑ๋ฒ•์น™์—์„œ Cauchy ์‘๋ ฅ ํ…์„œ๋ฅผ ์ง์ ‘ ๊ณ„์‚ฐํ•ด ์ ‘์ด‰๋ฉด์— ํˆฌ์˜ํ•˜๋Š” FEM ํ”„๋ ˆ์ž„์›Œํฌ๋กœ ํ’€๊ณ  ์ด๋ฅผ Isaac Sim ์ƒํƒœ๊ณ„์— ํ†ตํ•ฉํ•ฉ๋‹ˆ๋‹ค.
  2. โš™๏ธ WildMeshing ๊ธฐ๋ฐ˜ contact-aware ์ ์‘ ๋ฉ”์‹œ + UIPC(Unified Incremental Potential Contact) soft-body ์†”๋ฒ„๋กœ ๋ณ€ํ˜•์„ ํ’€๊ณ , deformation gradient์—์„œ Cauchy ์‘๋ ฅ \sigma๋ฅผ ๋ฝ‘์•„ traction t=\sigma n์„ normal pressure์™€ tangential traction์œผ๋กœ ๋ถ„ํ•ดํ•ด ๋ฌผ๋ฆฌ ๊ธฐ๋ฐ˜ ground-truth ํž˜์„ ์ œ๊ณตํ•ฉ๋‹ˆ๋‹ค.
  3. ๐ŸŽฏ ๋‹จ์ผ ํ™˜๊ฒฝ 33.40 FPSยท60 ๋ณ‘๋ ฌ 555 FPS ์ฒ˜๋ฆฌ๋Ÿ‰(์‘๋ ฅ ์ถ”์ถœ ์˜ค๋ฒ„ํ—ค๋“œ <1 ms)์—, ์‹ค๋ฌผ ๋Œ€๋น„ SSIM 0.93+ (ํ‰๊ท  0.9377) ๊ฒ€์ฆ, GelSight MiniยทDIGITยท9DTact ์„ธ ์„ผ์„œ๋ฅผ ์ตœ์†Œ ์„ค์ •์œผ๋กœ ํ†ตํ•ฉํ•ฉ๋‹ˆ๋‹ค.

๐Ÿ” Ping Review

๐Ÿ” Ping โ€” A light tap on the surface. Get the gist in seconds.

vision-based ์ด‰๊ฐ ์„ผ์„œ(VBTS)๋Š” ์‹ค๋ฆฌ์ฝ˜ ์ ค์ด ๋ฌผ์ฒด์— ๋ˆŒ๋ฆฌ๋ฉฐ ์ƒ๊ธฐ๋Š” ๋ณ€ํ˜•์„ ์นด๋ฉ”๋ผ๋กœ ์ฐ์–ด ๊ณ ํ•ด์ƒ๋„ ์ ‘์ด‰ ์ •๋ณด๋ฅผ ์ค€๋‹ค. ๊ฐ•ํ™”ํ•™์Šตยทsim-to-real๋กœ ์ด๋ฅผ ํ™œ์šฉํ•˜๋ ค๋ฉด ์ด ๋ถ€๋“œ๋Ÿฌ์šด ์ ‘์ด‰์„ ์‹œ๋ฎฌ๋ ˆ์ด์…˜ํ•ด์•ผ ํ•˜๋Š”๋ฐ, ๊ธฐ์กด ์‹œ๋ฎฌ๋ ˆ์ดํ„ฐ๋Š” ๊ฐˆ๋ฆผ๊ธธ์— ์„œ ์žˆ๋‹ค. TACTOยทTaxim ๊ฐ™์€ ๊ด‘ํ•™(optical) ๊ธฐ๋ฐ˜์€ ๊ฐ•์ฒด ์นจํˆฌ ๊นŠ์ด ๊ทผ์‚ฌ๋‚˜ ์˜ˆ์‹œ ๊ธฐ๋ฐ˜ ๊ธฐํ•˜ ๋งคํ•‘์œผ๋กœ ๋ณด๊ธฐ ์ข‹์€ ์ด‰๊ฐ ์ด๋ฏธ์ง€๋ฅผ ๋น ๋ฅด๊ฒŒ ๋งŒ๋“ค์ง€๋งŒ ํ‘œ๋ฉด ์••๋ ฅยท๋งˆ์ฐฐ traction ๊ฐ™์€ ๋ฌผ๋ฆฌ๋Ÿ‰์„ ์ „ํ˜€ ๊ณ„์‚ฐํ•˜์ง€ ๋ชปํ•œ๋‹ค. ๋ฐ˜๋Œ€๋กœ FEM ๊ธฐ๋ฐ˜์€ ๋ฌผ๋ฆฌ๋ฅผ ํ’€์ง€๋งŒ, ํ•™์Šต ๊ธฐ๋ฐ˜ ์—ญ์ถ”์ •(iFEM)์€ ๋ถˆํ™•์‹ค์„ฑ์„ ๋Œ์–ด๋“ค์ด๊ฑฐ๋‚˜(์‹ค์ธก ๋ณด์ • ํ•„์š”), TacSL์˜ Kelvin-Voigt ์Šคํ”„๋ง-๋Œํผ ๊ทผ์‚ฌ์ฒ˜๋Ÿผ ์ •ํ™•๋„๋ฅผ ์†๋„์™€ ๋งž๋ฐ”๊พผ๋‹ค. TaCauchy์˜ ์งˆ๋ฌธ์€ ๋ถ„๋ช…ํ•˜๋‹ค: โ€œ๊ทผ์‚ฌ ์—†์ด ์ œ1์›๋ฆฌ์—์„œ ์‹ ๋ขฐํ•  ํž˜์„, GPU ๋ณ‘๋ ฌ ํ•™์Šต์— ์“ธ ๋งŒํ•œ ์†๋„๋กœ, Isaac Sim ์•ˆ์—์„œ ์ค„ ์ˆ˜ ์žˆ๋Š”๊ฐ€?โ€


๊ฐœ์š”(Fig. 1) โ€” UIPC soft-body ๋™์—ญํ•™ + ์ž๋™ ์ ์‘ ๋ฉ”์‹œ + ํ•˜์ดํผํƒ„์„ฑ ๊ตฌ์„ฑ๋ฒ•์น™์—์„œ์˜ ์ง์ ‘ ์‘๋ ฅ ์ถ”์ถœ + ๋ชจ๋“ˆ์‹ ์„ผ์„œ ์ธํ„ฐํŽ˜์ด์Šค๋ฅผ Isaac Sim์— ํ†ตํ•ฉ. GelSight MiniยทDIGITยท9DTact๋ฅผ ๊ฐ•ํ™”ํ•™์Šต์šฉ mechanical ground truth์™€ ํ•จ๊ป˜ ์‹œ๋ฎฌ๋ ˆ์ด์…˜ํ•œ๋‹ค.

์ด๋ฆ„ ๊ทธ๋Œ€๋กœ ํ•ต์‹ฌ์€ Cauchy ์‘๋ ฅ ํ…์„œ๋‹ค. ๊ด‘ํ•™ ์‹œ๋ฎฌ๋ ˆ์ดํ„ฐ๊ฐ€ โ€œ์–ด๋–ป๊ฒŒ ๋ณด์ผ๊นŒโ€๋ฅผ ํ‰๋‚ด๋‚ด๋Š” ๋Œ€์‹ , TaCauchy๋Š” ๋ณ€ํ˜•์žฅ(deformation gradient field)์—์„œ ์ง„์งœ ์‘๋ ฅ ์ƒํƒœ๋ฅผ ๊ณ„์‚ฐํ•˜๊ณ  ์ด๋ฅผ ์ ‘์ด‰๋ฉด์— ํˆฌ์˜ํ•ด traction force๋ฅผ ์–ป๋Š”๋‹ค. ๊ฒฝํ—˜์  ์ถ”์ •์˜ ๋ถˆํ™•์‹ค์„ฑ ์—†์ด ๋ฌผ๋ฆฌ ๊ธฐ๋ฐ˜ ground truth๋ฅผ ์ œ๊ณตํ•œ๋‹ค๋Š” ๊ฒƒ์ด ํ•œ ์ค„ ์š”์ง€๋‹ค.


์‹œ๋ฎฌ๋ ˆ์ด์…˜ ํŒŒ์ดํ”„๋ผ์ธ(Fig. 2) โ€” ์„ผ์„œ geometry ์ž…๋ ฅ โ†’ ์ ์‘ ๋ฉ”์‹œ ์ž๋™ ์ƒ์„ฑ โ†’ UIPC-FEM ์†”๋ฒ„(ํ•˜์ดํผํƒ„์„ฑ์—์„œ ์ง์ ‘ ํž˜ ๊ณ„์‚ฐ) โ†’ Cauchy ์‘๋ ฅ ์ถ”์ถœยทtraction ๋ถ„ํ•ด โ†’ ๋ชจ๋“ˆ์‹ ์„ผ์„œ ์ธํ„ฐํŽ˜์ด์Šค + ์„ ํƒ์  ๊ด‘ํ•™ ๋ Œ๋”๋ง โ†’ Isaac Lab ๊ฐ•ํ™”ํ•™์Šต ์—ฐ๋™. ๋นจ๊ฐ„ ํ…Œ๋‘๋ฆฌ๊ฐ€ ํ•ต์‹ฌ ๊ธฐ์—ฌ ๋ชจ๋“ˆ.

ํ•ต์‹ฌ ๋ฐฉ๋ฒ•๋ก :

์ ค ํŒจ๋“œ๋Š” Stable Neo-Hookean ํ•˜์ดํผํƒ„์„ฑ ๋ชจ๋ธ๋กœ ๋ชจ๋ธ๋งํ•œ๋‹ค. Youngโ€™s modulus E์™€ Poissonโ€™s ratio \nu์—์„œ Lamรฉ ์ƒ์ˆ˜๋ฅผ ์–ป๊ณ (Eq. 1 โ€” ๊ด€๊ณ„์‹ ์ž์ฒด๋Š” \nu<0.5 ๋ฅผ ์š”๊ตฌํ•˜๊ณ , ์ ค์€ ๊ฑฐ์˜ ๋น„์••์ถ•์„ฑ์ด๋ผ \nu\approx 0.5 ๋กœ ์žก๋Š”๋‹ค):

\mu = \frac{E}{2(1+\nu)}, \qquad \lambda = \frac{E\,\nu}{(1+\nu)(1-2\nu)}

๋ณ€ํ˜• gradient F์—์„œ First Piola-Kirchhoff ์‘๋ ฅ P๋ฅผ ์–ป๊ณ (Eq. 2), ์ด๋ฅผ ํ˜„์žฌ(๋ณ€ํ˜•๋œ) ํ˜•์ƒ์˜ ์ง„์งœ ์‘๋ ฅ์ธ Cauchy ์‘๋ ฅ \sigma๋กœ ๋ณ€ํ™˜ํ•œ๋‹ค(Eq. 3, J=\det F):

P = \mu F + \lambda\bigl(\det(F)-1\bigr)\det(F)\,F^{-\top}, \qquad \sigma = \frac{1}{J}\,P\,F^{\top}

Eq. 2๋ฅผ Eq. 3์— ๋Œ€์ž…ํ•ด ์ •๋ฆฌํ•˜๋ฉด \sigma๊ฐ€ left Cauchy-Green ํ…์„œ b=FF^{\top}์™€ ํ•ญ๋“ฑ ํ…์„œ I๋งŒ์œผ๋กœ ๋–จ์–ด์ง„๋‹ค(Eq. 4):

\sigma = \frac{\mu}{J}\,b + \lambda\,(J-1)\,I

๊ทธ๋‹ค์Œ ํ‘œ๋ฉด ์‚ผ๊ฐํ˜•๋งˆ๋‹ค Cauchy ์‘๋ ฅ ์ •๋ฆฌ๋กœ traction์„ ๋ฝ‘๊ณ (Eq. 6) normal/tangential๋กœ ๋ถ„ํ•ดํ•œ๋‹ค(Eq. 8ยท9):

t=\sigma n,\qquad p = n^{\top}\sigma n,\qquad t_{\text{tan}} = t-(t\cdot n)\,n

p๋Š” ํ‘œ๋ฉด์— ์ˆ˜์ง์ธ ์••๋ ฅ(์Šค์นผ๋ผ, >0 ์ธ์žฅยท<0 ์••์ถ•), t_{\text{tan}}์€ ๋งˆ์ฐฐยท์Šฌ๋ฆฝ์„ ๊ฐ€๋ฅด๋Š” ์ „๋‹จ traction์ด๋‹ค. ๋™์—ญํ•™์€ UIPC ์†”๋ฒ„(IPC barrier \hat d=0.001 m, friction ratio 0.5, Newton ์ตœ๋Œ€ 1024 iter)๋กœ ํ’€์–ด ๋ฉ”์‹œ ๋ฐ˜์ „ยท๊ด€ํ†ต ์—†์ด ํฐ ๋ณ€ํ˜•์„ ๊ฒฌ๋”˜๋‹ค. ๋ฉ”์‹œ๋Š” WildMeshing์œผ๋กœ ์ƒ์„ฑํ•˜๋˜ ์ ‘์ด‰๋ฉด(ํŒจ๋“œ ํ•˜๋‹จ ๋‘๊ป˜์˜ 15% ์ด๋‚ด)์— per-vertex sizing field๋ฅผ ๋“ฑ๋กํ•ด ์ค‘์‹ฌ๋ถ€ edge length๋ฅผ ์ฝ”์‚ฌ์ธ ์ „์ด๋กœ ์กฐ๋ฐ€ํ™”ํ•œ๋‹ค.

์ฃผ์š” ๊ฒฐ๊ณผ:

  • ์„ฑ๋Šฅ(RTX 5090): ๋‹จ์ผ ํ™˜๊ฒฝ 33.40 FPS(headless)ยท9.23 FPS(GUI), 60 ๋ณ‘๋ ฌ ์‹œ ํ•ฉ์‚ฐ 555 FPS(headless)ยท455 FPS(GUI). ๋ฌผ๋ฆฌ ๊ณ„์‚ฐ์ด ์ง€๋ฐฐ์ (88.92 ms headless)์ด๊ณ  ์‘๋ ฅ ์ถ”์ถœ์€ <1 ms.
  • ์ ์‘ ๋ฉ”์‹œ(GelSight Mini): 661โ†’1,920 tet์œผ๋กœ 2.90ร— ์ฆ๊ฐ€, contact-center edge length 1.82 mmโ†’0.68 mm, ์ ‘์ด‰ ์˜์—ญ ๋ฉ”์‹œ ๋ฐ€๋„ 7.35ร— ํ–ฅ์ƒ(์ตœ์ข… 553 verticesยท712 faces).
  • ๋ฌผ๋ฆฌ ๊ฒ€์ฆ(UR5 + M3733C 6์ถ• F/T + ์›ํ†ต indenter): 6ํšŒ trial, 1.2556 N~4.7332 N. SSIM ํ‰๊ท  0.9377(>0.93), NCC 0.9669, Histogram Corr. 0.6920, PSNR 22.13 dB. ํž˜์ด ์ปค์งˆ์ˆ˜๋ก SSIM 0.947โ†’0.933์œผ๋กœ ๋ฏธ์„ธ ์ €ํ•˜.
  • ๋‹ค์ค‘ ์„ผ์„œ ๊ด‘ํ•™ ๊ฒ€์ฆ: GelSight Mini SSIM 0.9277ยทPSNR 22.45 dB, DIGIT SSIM 0.9215ยทPSNR 25.42 dB.

๊ฒฐ๋ก : ๊ด‘ํ•™ ์‹œ๋ฎฌ๋ ˆ์ดํ„ฐ์˜ โ€œ๋ณด๊ธฐ ์ข‹์ง€๋งŒ ํž˜ ์—†๋Š”โ€ ํ•œ๊ณ„์™€ ๋‹จ์ˆœํ™” FEM์˜ โ€œ๋น ๋ฅด์ง€๋งŒ ๋ถ€์ •ํ™•ํ•œโ€ ํ•œ๊ณ„ ์‚ฌ์ด์—์„œ, TaCauchy๋Š” UIPC๋กœ ์ œ1์›๋ฆฌ ์‘๋ ฅ์„ ํ’€๊ณ  ์ด๋ฅผ Isaac Sim์— ์–น์–ด ์ •ํ™•ํ•œ ํž˜ + ์‚ฌ์‹ค์  ์ด๋ฏธ์ง€๋ฅผ ํ•œ ํ”„๋ ˆ์ž„์›Œํฌ๋กœ ์ œ๊ณตํ•œ๋‹ค. ์ €์ž๋“ค์€ SSIM 0.93+๊ฐ€ โ€œsim-to-real ์ „์ด์— ํ•„์š”ํ•œ ๊ตฌ์กฐ์  ์ •ํ™•๋„โ€๋ฅผ ๋’ท๋ฐ›์นจํ•œ๋‹ค๊ณ  ์ฃผ์žฅํ•˜๋ฉฐ(ยงIV-B), ๋ชจ๋“ˆ์‹ ์ธํ„ฐํŽ˜์ด์Šค๋กœ ์ด์ข… ์„ผ์„œ ํ™•์žฅ์„ฑ์„ ๋ณด์˜€๋‹ค. ๋‹ค๋งŒ ๊ทธ ์ „์ด ์ž์ฒด๋ฅผ ์‹คํ—˜์œผ๋กœ ๋ณด์ธ ๊ฒƒ์€ ์•„๋‹ˆ๋‹ค.

๐Ÿ”” Ring Review

๐Ÿ”” Ring โ€” An idea that echoes. Grasp the core and its value.

ํ•œ ์ค„๋กœ ์‹œ์ž‘ํ•˜๋ฉด

TaCauchy์˜ ํ•œ ๋ฌธ์žฅ์€ โ€œ์ด‰๊ฐ ์ด๋ฏธ์ง€๋ฅผ ํ‰๋‚ด๋‚ด์ง€ ๋ง๊ณ , ์‘๋ ฅ์„ ๊ณ„์‚ฐํ•ด์„œ ๊ฑฐ๊ธฐ์„œ ์ด๋ฏธ์ง€์™€ ํž˜์„ ํ•จ๊ป˜ ๋Œ์–ด๋‚ด๋ผโ€๋‹ค. Cauchy ์‘๋ ฅ ํ…์„œ๋ฅผ first-principle๋กœ ๊ณ„์‚ฐํ•˜๋Š” ์ด ํ•œ ๊ฒฐ์ •์ด, ๊ด‘ํ•™ ์‹œ๋ฎฌ๋ ˆ์ดํ„ฐ์—” ์—†๋˜ mechanical ground truth(์••๋ ฅยท์ „๋‹จ traction)๋ฅผ ๊ณต์งœ์— ๊ฐ€๊น๊ฒŒ(<1 ms) ๋ถ€์‚ฐ๋ฌผ๋กœ ๋‚ด๋†“๊ณ , ๋™์‹œ์— ๊ทธ ๋ณ€ํ˜• ๋ฉ”์‹œ๋ฅผ ๊ด‘ํ•™ ๋ Œ๋”์˜ ๋ฌผ๋ฆฌ์  ๊ฒฝ๊ณ„๋กœ ์จ์„œ ์ด๋ฏธ์ง€ ์‚ฌ์‹ค์„ฑ๊นŒ์ง€ ๋Œ์–ด์˜ฌ๋ฆฐ๋‹ค.

์™œ ์–ด๋ ค์šด๊ฐ€: โ€œ๋ณด๊ธฐ ์ข‹์€ ์ด๋ฏธ์ง€โ€์™€ โ€œ๋ฏฟ์„ ํž˜โ€ ์‚ฌ์ด

VBTS ์‹œ๋ฎฌ๋ ˆ์ด์…˜์€ ๋‘ ์ง„์˜์œผ๋กœ ๊ฐˆ๋ฆฐ๋‹ค.

  • ๊ด‘ํ•™ ์ง„์˜(TACTO, Taxim): ๊ฐ•์ฒด ์นจํˆฌ ๊นŠ์ด๋‚˜ ์˜ˆ์‹œ ๊ธฐ๋ฐ˜ ๋งคํ•‘์œผ๋กœ ์ด‰๊ฐ ์ด๋ฏธ์ง€๋ฅผ ์ƒ์„ฑํ•œ๋‹ค. ๋น ๋ฅด๊ณ  ์‹œ๊ฐ์ ์œผ๋กœ ๊ทธ๋Ÿด๋“ฏํ•˜์ง€๋งŒ, ํ‘œ๋ฉด ์••๋ ฅยท๋งˆ์ฐฐ tractionยท์ ค์˜ ์‹ค์ œ ๋ณ€ํ˜• ๊ฐ™์€ ๋ฌผ๋ฆฌ๋Ÿ‰์„ ๋งŒ๋“ค ์ˆ˜ ์—†๋‹ค. contact-rich ์กฐ์ž‘์ฒ˜๋Ÿผ ํž˜ ํ”ผ๋“œ๋ฐฑ์ด ์„ฑํŒจ๋ฅผ ๊ฐ€๋ฅด๋Š” ํƒœ์Šคํฌ์—” ๋ถ€์กฑํ•˜๋‹ค.
  • FEM ์ง„์˜: ๋ฌผ๋ฆฌ๋ฅผ ํ’€์ง€๋งŒ ์ ‘๊ทผ๋งˆ๋‹ค ์•ฝ์ ์ด ๋‹ค๋ฅด๋‹ค. iFEM ๊ฐ™์€ ํ•™์Šต ๊ธฐ๋ฐ˜ ์—ญ์ถ”์ •์€ ๊ด€์ธก๋œ ๋ณ€ํ˜•์—์„œ ํž˜์„ ๊ฑฐ๊พธ๋กœ ์ถ”์ •ํ•ด ๋ถˆํ™•์‹ค์„ฑ๊ณผ ์‹ค์ธก ๋ณด์ • ๋น„์šฉ์„ ์•ˆ๊ณ , TacSL์˜ Kelvin-Voigt๋Š” full FEM์„ ์Šคํ”„๋ง-๋Œํผ๋กœ ๋Œ€์ฒดํ•ด 200ร— ์ด์ƒ ๋นจ๋ผ์ง€๋Š” ๋Œ€์‹  ์ •ํ™•๋„๋ฅผ ๊ฒฝํ—˜์  ๊ทผ์‚ฌ์™€ ๋งž๋ฐ”๊พผ๋‹ค. TacIPCยทDIFFTACTILE์€ ์ •ํ™•ํ•˜์ง€๋งŒ Isaac ์ƒํƒœ๊ณ„ ๋ฐ–์ด๋ผ ๋Œ€๊ทœ๋ชจ ๋ณ‘๋ ฌ RL์— ์“ฐ๊ธฐ ์–ด๋ ต๋‹ค.

์ €์ž๊ฐ€ ์งš๋Š” ๋นˆ์นธ์€ ๋ช…ํ™•ํ•˜๋‹ค: rigorousํ•œ ์‘๋ ฅยท์••๋ ฅยทtraction์„ ์ œ1์›๋ฆฌ๋กœ ์ฃผ๋ฉด์„œ, ์‚ฌ์‹ค์  ์ด‰๊ฐ ์ด๋ฏธ์ง€๋ฅผ ๋งŒ๋“ค๊ณ , Isaac Sim์˜ GPU ๋ณ‘๋ ฌ ํ•™์Šต์— ๋งž๋Š” ํšจ์œจ์„ ์œ ์ง€ํ•˜๋Š” ์‹œ์Šคํ…œ. TaCauchy๋Š” TacEx์˜ Isaac ํ†ตํ•ฉ ์œ„์—, ์™„์ „ํ•œ ํž˜ ๊ณ„์‚ฐ(full Cauchy ์‘๋ ฅ ์ถ”์ถœ + ๋ฒ•์„ /์ „๋‹จ ๋ถ„ํ•ด)์„ ์–น๋Š” ๊ฒƒ์œผ๋กœ ๊ทธ ์ž๋ฆฌ๋ฅผ ๋…ธ๋ฆฐ๋‹ค.

๋ฐฉ๋ฒ• ์ƒ์„ธ

1) ๋ฉ”์‹œ: contact-aware ์ ์‘ ์„ธ๋ถ„ํ™”

์ ค elastomer๋ฅผ ์‚ฌ๋ฉด์ฒด(tetrahedral) ๋ฉ”์‹œ๋กœ ๋ชจ๋ธ๋งํ•œ๋‹ค. ์ƒ์„ฑ๊ธฐ๋Š” WildMeshing์œผ๋กœ, intersection-freeยทinversion-freeยทmanifold-valid ๋ฉ”์‹œ๋ฅผ ๋ณด์žฅํ•œ๋‹ค. ํ‘œ๋ฉด ์‚ผ๊ฐํ™” โ†’ ์ฒด์  ์‚ฌ๋ฉด์ฒดํ™” ์ˆœ์œผ๋กœ ์ง„ํ–‰ํ•˜๋ฉฐ, ํ•ต์‹ฌ ํŒŒ๋ผ๋ฏธํ„ฐ๋Š” ์ƒ๋Œ€ target edge length(์ „์—ญ ๋ฐ€๋„), envelope(๋ฏธ์„ธ ํ‘œ๋ฉด ๋ณด์กด), AMIPS ์—๋„ˆ์ง€ ์ž„๊ณ„(์š”์†Œ ํ’ˆ์งˆ), stopping quality(์ตœ์•… ์ข…ํšก๋น„ ์ƒํ•œ)๋‹ค.

์—ฌ๊ธฐ์— geometry-aware adaptive refinement๋ฅผ ๋”ํ•œ๋‹ค. ํ•ต์‹ฌ์€ WildMeshing์˜ per-vertex sizing field๋ฅผ ์‚ฌ๋ฉด์ฒดํ™” ์ปค๋„์— ์ง์ ‘ ๋“ฑ๋กํ•˜๋Š” ๊ฒƒ โ€” ํ›„์ฒ˜๋ฆฌ ์„ธ๋ถ„ํ™”๊ฐ€ ์•„๋‹ˆ๋ผ Delaunay ์ตœ์ ํ™” ์ค‘์— ๋ฐ€๋„๊ฐ€ ์กฐ์ ˆ๋ผ ์ „์ด ์˜์—ญ์—์„œ๋„ well-shaped tet์ด ๋‚˜์˜จ๋‹ค. ์ž‘๋™ ๋ฐฉ์‹:

  1. ๋ฐ”์šด๋”ฉ ๋ฐ•์Šค์—์„œ ๊ฐ€์žฅ ์–‡์€ ์ถ•์„ ํŒจ๋“œ ๋‘๊ป˜ ๋ฐฉํ–ฅ์œผ๋กœ ์ž๋™ ์‹๋ณ„ํ•˜๊ณ , ํ•˜๋‹จ๋ฉด์—์„œ ๋‘๊ป˜์˜ 15% ์ด๋‚ด ์ •์ ์„ contact surface๋กœ ๋ผ๋ฒจ๋ง.
  2. ๊ทธ ํ‘œ๋ฉด์— ๋ฐฉ์‚ฌํ˜• ๋ฐ€๋„ ํ”„๋กœํŒŒ์ผ ์ ์šฉ โ€” ์ค‘์‹ฌ๋ถ€(ํ‰๋ฉด half-extent์˜ r_c=40\% ์ด๋‚ด)๋Š” fine edge length l_c\approx 0.8 mm, ์ฃผ๋ณ€๋ถ€๋Š” ์ „์—ญ coarse ํ•ด์ƒ๋„ l_g\approx 3.2 mm.
  3. ๋‘ ์˜์—ญ ์‚ฌ์ด๋ฅผ ํญ r_t=20\%(half-extent ๊ธฐ์ค€)์˜ ์ฝ”์‚ฌ์ธ ํ‰ํ™œ ์ „์ด ๋ฐด๋“œ๋กœ ์ด์–ด ๊ฐ•์„ฑ ๋ถˆ์—ฐ์†์„ ํ”ผํ•จ.

GelSight Mini ๊ธฐ์ค€์œผ๋กœ baseline 661 tet โ†’ 1,920 tet(2.90ร—)์œผ๋กœ ๋Š˜๋˜, contact-center edge length๋ฅผ 1.82 mmโ†’0.68 mm๋กœ ์ค„์—ฌ ์ ‘์ด‰ ์˜์—ญ๋งŒ 7.35ร— ์กฐ๋ฐ€ํ•ด์ง„๋‹ค(์ตœ์ข… 553 vertices / ๊ทธ์ค‘ ํ‘œ๋ฉด 358 / 712 triangular faces). ์ž์›์„ ์ ‘์ด‰์ด ์ผ์–ด๋‚˜๋Š” ๊ณณ์— ์ง‘์ค‘์‹œํ‚ค๋Š”, ๋น„์šฉ-์ •ํ™•๋„ trade์˜ ์˜๋ฆฌํ•œ ์ ˆ์ถฉ์ด๋‹ค.

2) ๊ตฌ์„ฑ๋ฒ•์น™๊ณผ UIPC ์†”๋ฒ„

์žฌ๋ฃŒ๋Š” Stable Neo-Hookean(Smith et al. 2018)์ด๋‹ค. ์„ ํƒ ๊ทผ๊ฑฐ๊ฐ€ ์…‹: โ‘  Neo-Hookean์€ ๊ฐ€๊ต ๊ณ ๋ถ„์ž ์‚ฌ์Šฌ์˜ ํ†ต๊ณ„ ์—ด์—ญํ•™์— ๊ทผ๊ฑฐํ•ด ์‹ค๋ฆฌ์ฝ˜ ๊ณ ๋ฌด์˜ ๊ฑฐ๋™์„ ์ž˜ ์žก๊ณ , โ‘ก Stable ๋ณ€ํ˜•์€ ๊ทน๋‹จ์  ๋ณ€ํ˜•ยท์š”์†Œ ๋ฐ˜์ „์—์„œ ์ˆ˜์น˜์ ์œผ๋กœ ๊ฐ•๊ฑดํ•˜๋ฉฐ(๊ณ ์ฃผํŒŒ ์ ‘์ด‰์—์„œ ์ž์ฃผ ๋ฐœ์ƒ), โ‘ข ๊ฑฐ์˜ ๋น„์••์ถ•์„ฑ์ธ(\nu\approx 0.5) ์ ค์˜ ๋ถ€ํ”ผ ๋ณด์กด์„ ์ž˜ ์ง€ํ‚จ๋‹ค. E,\nu์—์„œ Lamรฉ ์ƒ์ˆ˜ \mu(์ „๋‹จ)ยท\lambda(์ฒด์ )๋ฅผ ์–ป๊ณ (Eq. 1 โ€” ์ด ๊ด€๊ณ„์‹์€ \nu<0.5 ์—์„œ๋งŒ ์ •์˜๋œ๋‹ค), ๋ณ€ํ˜• gradient F์—์„œ PK1 ์‘๋ ฅ P=\mu F+\lambda(\det F-1)\det F\,F^{-\top} ๋ฅผ ๋„์ถœํ•œ๋‹ค(Eq. 2).

๋™์—ญํ•™์€ UIPC ์—”์ง„์˜ ์ตœ์ ํ™” ๊ธฐ๋ฐ˜ ์ ๋ถ„์œผ๋กœ ํ‘ผ๋‹ค. IPC barrier ๊ฑฐ๋ฆฌ \hat d=0.001 m, velocity threshold 0.01 m/s, frictional contact ratio 0.5, Newton ์†”๋ฒ„ ์ตœ๋Œ€ 1024 iter/step โ€” ํฐ ์ „๋‹จ ํ•˜์ค‘์—์„œ๋„ ๊ด€ํ†ตยท๋ฐ˜์ „ ์—†์ด ์ˆ˜๋ ดํ•˜๋„๋ก ์„ค์ •ํ–ˆ๋‹ค.

3) Cauchy ์‘๋ ฅ ์ถ”์ถœ๊ณผ traction ๋ถ„ํ•ด (ํ•ต์‹ฌ ๊ธฐ์—ฌ)

์—”์ง€๋‹ˆ์–ด๋ง ์ธก ํ•ต์‹ฌ์€ UIPC ๋ณ€ํ˜•์žฅ์—์„œ Cauchy ์‘๋ ฅ \sigma๋ฅผ ์ง์ ‘ ๋ฝ‘์•„ ํ‘œ๋ฉด์— ํˆฌ์˜ํ•˜๋Š” ๊ฒƒ์ด๋‹ค. ํ˜„์žฌ(๋ณ€ํ˜•๋œ) ํ˜•์ƒ์˜ ์ง„์งœ ์‘๋ ฅ ์ƒํƒœ๋Š” PK1์—์„œ:

\sigma = \frac{1}{J}\,P\,F^{\top}, \qquad J=\det F

Eq. 2๋ฅผ ๋Œ€์ž…ยท์ •๋ฆฌํ•˜๋ฉด \sigma=\tfrac{\mu}{J}b+\lambda(J-1)I ๋กœ, left Cauchy-Green ํ…์„œ b=FF^{\top}์™€ ํ•ญ๋“ฑ I์˜ ํ•จ์ˆ˜๊ฐ€ ๋œ๋‹ค(Eq. 4) โ€” ๊ฒฝํ—˜์  fitting์ด ์•„๋‹ˆ๋ผ ๊ณ ๋ถ„์ž ํƒ„์„ฑ์˜ ํ†ต๊ณ„ ์—ด์—ญํ•™์— ๋ฟŒ๋ฆฌ๋ฅผ ๋‘” ํ˜•ํƒœ๋ผ๋Š” ๊ฒŒ ์ €์ž๋“ค์˜ ๋…ผ๊ฑฐ๋‹ค. ๋Œ€์นญ \sigma๋Š” 9์„ฑ๋ถ„(๋Œ€์นญ์œผ๋กœ 6 ๋…๋ฆฝ), ๋Œ€๊ฐ์ด ๋ฒ•์„  ์‘๋ ฅ(์ธ์žฅ/์••์ถ•), ๋น„๋Œ€๊ฐ์ด ์ „๋‹จ ์‘๋ ฅ์ด๋‹ค.

ํ‘œ๋ฉด ํˆฌ์˜(Algorithm 1)์€ ๊ฐ surface triangle๋งˆ๋‹ค: ๋ถ€๋ชจ tet์˜ ์‘๋ ฅ ํ…์„œ๋ฅผ ๊ฐ€์ ธ์™€ ํ‘œ๋ฉด ๋ฒ•์„  n์„ ๊ตฌํ•˜๊ณ , Cauchy ์‘๋ ฅ ์ •๋ฆฌ๋กœ traction์„ ๊ณ„์‚ฐํ•œ ๋’ค ๋ฒ•์„ ยท์ ‘์„ ์œผ๋กœ ๋ถ„ํ•ดํ•œ๋‹ค:

t=\sigma n \quad(\text{traction}), \qquad p = n^{\top}\sigma n \quad(\text{normal pressure}), \qquad t_{\text{tan}} = t-(t\cdot n)\,n \quad(\text{tangential})

p๋Š” ์Šค์นผ๋ผ ์••๋ ฅ(p>0 ์ธ์žฅ, p<0 ์••์ถ•), t_{\text{tan}}์€ ํ‘œ๋ฉด์— ํ‰ํ–‰ํ•œ ์ „๋‹จ ๋ฒกํ„ฐ๋กœ ๊ตฌ์„ฑ์ƒ t_{\text{tan}}\cdot n=0์„ ๋งŒ์กฑํ•œ๋‹ค. \lVert t_{\text{tan}}\rVert์ด ๊ณง ๋งˆ์ฐฐยท์Šฌ๋ฆฝ์„ ํŒ๋‹จํ•˜๋Š” ์ „๋‹จ ๊ฐ•๋„๋‹ค. ์ „์ฒด ๋ฃจํ”„(Algorithm 2)๋Š” ๋ฉ”์‹œ ์ƒ์„ฑ โ†’ UIPC step โ†’ tet๋ณ„ \sigma ๊ณ„์‚ฐ โ†’ ํ‘œ๋ฉด ์‚ผ๊ฐํ˜•๋ณ„ ๋ถ„ํ•ด๋ฅผ ๋งค ์Šคํ… ํ†ตํ•ฉํ•œ๋‹ค. ์—ฌ๊ธฐ์— ์ ‘์ด‰ ์ •์  ๊ฒฝ๋กœ๊ฐ€ ํ•˜๋‚˜ ๋” ๋ถ™๋Š”๋ฐ, IPC ์ ‘์ด‰ ์—๋„ˆ์ง€์˜ gradient \mathbf{g}_k์—์„œ \mathbf{f}_k=-\mathbf{g}_k/\Delta t^2๋กœ ์ ˆ์ ๋ ฅ์„ ๋ณต์›ํ•˜๊ณ  ๋ฒ•์„ /์ ‘์„  ๋ถ„ํ•ด ํ›„ ์ •์  ๋ฉด์  A_k๋กœ ๋‚˜๋ˆ  ์••๋ ฅ p_k=\lVert\mathbf{f}_k\rVert/A_k๋ฅผ ์–ป๋Š”๋‹ค(Alg. 2, 10โ€“15ํ–‰). ์ฆ‰ ์‘๋ ฅ์žฅ ๊ฒฝ๋กœ(์—ฐ์†์ฒด)์™€ ์ ‘์ด‰๋ ฅ ๊ฒฝ๋กœ(IPC)๋ฅผ ๋‘˜ ๋‹ค ๋‚ด๋†“๋Š” ๊ตฌ์กฐ๋‹ค. ์ด๋ ‡๊ฒŒ ์–ป์€ ํž˜์€ ์—ญ์ถ”์ •์˜ ๋ถˆํ™•์‹ค์„ฑ๋„, ๋‹จ์ˆœ ๊ฒฝํ—˜ ๋ชจ๋ธ์˜ ๋ถ€์ •ํ™•ํ•จ๋„ ์—†๋Š” ์ˆœ์ˆ˜ ๋ฌผ๋ฆฌ ground truth๋ผ๋Š” ๊ฒŒ ์ €์ž ์ฃผ์žฅ์ด๋‹ค.

4) ๋ฌผ๋ฆฌ ์ œ์•ฝ ๊ด‘ํ•™ ๋ Œ๋”๋ง

์ด๋ฏธ์ง€๋Š” ๋ณ„๋„ ๋ชจ๋“ˆ๋กœ ํ•ฉ์„ฑํ•˜๋˜, ๊ธฐ์กด ๋ถ„๋ฆฌํ˜•(๊ด‘ํ•™๊ณผ ๋ฌผ๋ฆฌ๊ฐ€ ๋…๋ฆฝ)๊ณผ ๋‹ฌ๋ฆฌ FEM ๋ณ€ํ˜• ๋ฉ”์‹œ๋กœ ๋ฌผ๋ฆฌ ์ œ์•ฝ์„ ๊ฑด๋‹ค. Taxim ๋“ฑ์—์„œ ํ”ํ•œ ์ ค-๋ฌผ์ฒด ๋น„์ •์ƒ ๊ด€ํ†ต(interpenetration)์€, ๊ด‘ํ•™ depth ์ƒ์„ฑ์— ๋ฌผ๋ฆฌ ์ ‘์ด‰ ์ œ์•ฝ์ด ์—†์–ด์„œ ์ƒ๊ธด๋‹ค. TaCauchy๋Š” FEM์ด ํ‘ผ non-penetrating ๋ฉ”์‹œ๋ฅผ ๊ด‘ํ•™ ๋ชจ๋“ˆ์˜ ์—„๊ฒฉํ•œ ๋ฌผ๋ฆฌ ๊ฒฝ๊ณ„๋กœ ์จ์„œ depth map์„ ๊ทธ ๋ณ€ํ˜• ์ฒด์  ์•ˆ์œผ๋กœ ์ œํ•œํ•œ๋‹ค โ€” ์‹œ๊ฐ ์‹ ํ˜ธ๊ฐ€ ์‹ค์ œ ์ ‘์ด‰ ์ƒํƒœ๋ฅผ ๋ฐ˜์˜ํ•˜๊ฒŒ ๋œ๋‹ค. ๋งˆ์ปค๊ฐ€ ์žˆ๋Š” ์„ผ์„œ์—” FOTS ํ”„๋ ˆ์ž„์›Œํฌ๋กœ ๋งˆ์ปค ๋™์—ญํ•™์„ ์ž…ํžŒ๋‹ค.

์ง๊ด€: ์™œ โ€œ์‘๋ ฅ์„ ๋จผ์ €โ€๊ฐ€ ์ด๋“์ธ๊ฐ€

๊ด‘ํ•™ ์‹œ๋ฎฌ๋ ˆ์ดํ„ฐ๋Š” ์ ‘์ด‰์˜ ๊ฒฐ๊ณผ(์ด๋ฏธ์ง€)๋ฅผ ๋ชจ๋ธ๋งํ•˜์ง€๋งŒ, contact-rich ํ•™์Šต์— ์ •์ž‘ ํ•„์š”ํ•œ ๊ฑด ์›์ธ(ํž˜์žฅ)์ด๋‹ค. TaCauchy๋Š” ์ˆœ์„œ๋ฅผ ๋’ค์ง‘์–ด ์‘๋ ฅ์„ ๋จผ์ € ํ’€๊ณ , ๊ฑฐ๊ธฐ์„œ ์ด๋ฏธ์ง€์™€ ํž˜์„ ํ•จ๊ป˜ ํŒŒ์ƒ์‹œํ‚จ๋‹ค. ์ด ํ•œ ๊ฒฐ์ •์ด ๋‘ ๊ฐ€์ง€๋ฅผ ๋™์‹œ์— ์–ป๊ฒŒ ํ•œ๋‹ค โ€” (1) ์••๋ ฅยท์ „๋‹จ traction์ด๋ผ๋Š”, ๊ด‘ํ•™ ๋ฐฉ์‹์—” ์›์ฒœ์ ์œผ๋กœ ์—†๋Š” supervision์ด ๊ฑฐ์˜ ๊ณต์งœ๋กœ(์ถ”์ถœ <1 ms) ๋”ฐ๋ผ์˜ค๊ณ , (2) ๊ฐ™์€ ๋ณ€ํ˜• ๋ฉ”์‹œ๊ฐ€ ๊ด‘ํ•™ ๋ Œ๋”์˜ ๋ฌผ๋ฆฌ ๊ฒฝ๊ณ„๊ฐ€ ๋ผ ๊ด€ํ†ต ์•„ํ‹ฐํŒฉํŠธ๋ฅผ ์—†์• ๋ฏ€๋กœ ์ด๋ฏธ์ง€ ์‚ฌ์‹ค์„ฑ๊นŒ์ง€ ์˜ฌ๋ผ๊ฐ„๋‹ค. โ€œ๋ณด๊ธฐ ์ข‹๊ฒŒ ๋งŒ๋“ค๊ธฐโ€์™€ โ€œ๋ฏฟ์„ ํž˜ ์ฃผ๊ธฐโ€๊ฐ€ ๋ณ„๊ฐœ ๋ชฉํ‘œ๊ฐ€ ์•„๋‹ˆ๋ผ ๊ฐ™์€ ์‘๋ ฅ์žฅ์—์„œ ๋‚˜์˜ค๋Š” ํ•œ ์Œ์ด ๋œ๋‹ค.

์‹คํ—˜

์…‹์—…๊ณผ ์„ฑ๋Šฅ

์›Œํฌ์Šคํ…Œ์ด์…˜์€ AMD Ryzen 9 9950X + RTX 5090, Isaac Sim 5.1.0 / Isaac Lab 0.51.1 + UIPC. ์„ธ ์„ผ์„œ(GelSight MiniยทDIGITยท9DTact)๋ฅผ ๊ฐ๊ฐ Franka Panda์— ์žฅ์ฐฉํ•ด ํ‰๊ฐ€ํ–ˆ๋‹ค. ์„ฑ๋Šฅ์€ ๋‹จ์ผ 33.40 FPS(headless)ยท9.23 FPS(GUI), 60 ๋ณ‘๋ ฌ ์‹œ 9.25/7.59 FPS โ†’ ํ•ฉ์‚ฐ 555/455 FPS. ๋ฌผ๋ฆฌ๊ฐ€ ์‹œ๊ฐ„์„ ์ง€๋ฐฐ(88.92 ms headless, 102.72 ms GUI)ํ•˜๊ณ  ์‘๋ ฅ ์ถ”์ถœ์€ <1 ms๋กœ ๋ฌด์‹œํ•  ์ˆ˜์ค€ โ€” ํ•ต์‹ฌ ๊ธฐ์—ฌ(์‘๋ ฅ ์ถ”์ถœ)๊ฐ€ ๋ณ‘๋ชฉ์ด ์•„๋‹ˆ๋ผ๋Š” ์ ์„ ๋ณด์ธ ์…ˆ์ด๋‹ค.

๋ฌผ๋ฆฌ ๊ฒ€์ฆ: ์‹ค๋ฌผ ๋Œ€๋น„ SSIM 0.93+

UR5 ํ˜‘๋™๋กœ๋ด‡ EE์— M3733C 6์ถ• F/T ์„ผ์„œ๋ฅผ ๋‹ฌ๊ณ  ์›ํ†ต indenter(์ง€๋ฆ„ 5 mmยท๋†’์ด 10 mm)๋กœ GelSight Mini๋ฅผ ์ˆ˜์ง ๊ฐ€์••ํ–ˆ๋‹ค. ํž˜์€ 100 Hzยท0.0001 N ํ•ด์ƒ๋„๋กœ, ์ด‰๊ฐ ์ด๋ฏธ์ง€๋Š” 25 FPS๋กœ ํ•˜๋“œ์›จ์–ด ํŠธ๋ฆฌ๊ฑฐ ๋™๊ธฐํ™” ๊ธฐ๋ก. 6 trial, target force 1.2556 N~4.7332 N. ์‹œ๋ฎฌ๋ ˆ์ด์…˜์€ ๋™์ผ ํ˜•์ƒยท์žฌ๋ฃŒ๋กœ ๋ณ€์œ„ ๊ฒฝ๊ณ„์กฐ๊ฑด์„ ์ค˜ ์ธก์ • F_z๋ฅผ 0.0800 N ์˜ค์ฐจ ๋‚ด๋กœ ๋งž์ถ˜ ๋’ค ๊ฐ™์€ photometric ๋ชจ๋ธ๋กœ ๋ Œ๋”ํ–ˆ๋‹ค(Fig. 4 ๊ธฐ์ค€ ์‹ค์ธก 1.2556 / 1.8686 / 2.8766 / 3.6195 / 4.2234 / 4.7332 N์— ๋Œ€ํ•ด ์‹œ๋ฎฌ์€ 1.2362 / 1.8932 / 2.8237 / 3.6332 / 4.2933 / 4.7632 N โ€” ์ตœ๋Œ€ ์˜ค์ฐจ๋Š” 4.2234 N ์‹œํ–‰์˜ 0.070 N์œผ๋กœ ์„ ์–ธํ•œ 0.0800 N ํ—ˆ์šฉ์น˜ ์•ˆ์— ๋“ค์–ด์˜จ๋‹ค).


์‹ค๋ฌผ vs ์‹œ๋ฎฌ ์ด‰๊ฐ ์ด๋ฏธ์ง€(Fig. 4) โ€” 6๊ฐœ ํž˜ ๋ ˆ๋ฒจ์— ๋Œ€ํ•ด (1ํ–‰) ์‹ค์ œ ์„ผ์„œ, (2ํ–‰) ์‹œ๋ฎฌ, (3ํ–‰) ํ”ฝ์…€ ์ฐจ์ด. ํž˜์ด ์ปค์งˆ์ˆ˜๋ก ์ ‘์ด‰ ๋ฉด์ ์ด ์›ํ†ต ํ˜•์ƒ๋Œ€๋กœ ์›ํ˜• ๋Œ€์นญ์œผ๋กœ ํ™•์žฅ๋˜๊ณ , ๋ฐ์€ ์ค‘์‹ฌ + ์–ด๋‘์šด ์ฃผ๋ณ€ ํŒจํ„ด์ด ์–‘์ชฝ์—์„œ ์ผ๊ด€. ๊ทธ๋ฆผ ์•ˆ์— ์‹œํ–‰๋ณ„ MAE 16.84~17.74, SSIM 0.947 / 0.940 / 0.938 / 0.932 / 0.933 / 0.933์ด ํ•จ๊ป˜ ํ‘œ๊ธฐ๋ผ ์žˆ๋‹ค.

์ •๋Ÿ‰ ์ง€ํ‘œ(ํ‰๊ท ): SSIM 0.9377(์ „ ๊ตฌ๊ฐ„ >0.93), NCC 0.9669, Histogram Correlation 0.6920, PSNR 22.13 dB, MSE 372.0~414.1. ํž˜์ด 1.2556 Nโ†’4.7332 N์œผ๋กœ ์ปค์ง€๋ฉด SSIM 0.947โ†’0.933, NCC 0.974โ†’0.965, PSNR 22.43โ†’22.03 dB๋กœ ๋ฏธ์„ธ ์ €ํ•˜ โ€” ๋ณ€ํ˜•์ด ์ปค์งˆ์ˆ˜๋ก ๊ธฐํ•˜ ๋น„์„ ํ˜•์„ฑยท์žฌ๋ฃŒ ๋ถˆํ™•์‹ค์„ฑ์ด ์ปค์ง€๋Š” ๊ฒƒ๊ณผ ๋ถ€ํ•ฉํ•˜๋‚˜ ์ „ ๊ตฌ๊ฐ„ ํ—ˆ์šฉ ๋ฒ”์œ„ ์œ ์ง€. Histogram Correlation(0.69)์ด ์ƒ๋Œ€์ ์œผ๋กœ ๋‚ฎ์€ ๊ฑด ์กฐ๋ช…/์ƒ‰ ๋ณด์ • ์ฐจ์ด์— ๋ฏผ๊ฐํ•˜๊ธฐ ๋•Œ๋ฌธ์ด๋ผ๊ณ  ์„ค๋ช…ํ•œ๋‹ค.

์ ‘์ด‰ ๋ชจ๋“œ ๋ถ„์„: ํž˜์žฅ์ด ๋ฌผ๋ฆฌ๋ฅผ ๋“œ๋Ÿฌ๋‚ด๋Š”๊ฐ€

์›ํ†ต indenter๋กœ ์„ธ ์ •์ค€ ์ ‘์ด‰ ๋ชจ๋“œ๋ฅผ ์ •์„ฑ ๋ถ„์„ํ•œ๋‹ค.


์„ธ ์ ‘์ด‰ ๋ชจ๋“œ ํž˜์žฅ(Fig. 7) โ€” (์œ„) normal pressing, (์ค‘) tangential translation, (์•„๋ž˜) rotation. ์—ด: (์ขŒ) ๊ธฐํ•˜ยท์ ‘์ด‰ ๋ทฐ, (์ค‘) ๋ฒ•์„  ํž˜์žฅ, (์šฐ) ์ ‘์„  ํž˜์žฅ. ์‘๋ ฅ ๋ถ„ํ•ด๊ฐ€ ๊ฐ ์ƒํ˜ธ์ž‘์šฉ์˜ ๋ฌผ๋ฆฌ์  ์„œ๋ช…์„ ๋“œ๋Ÿฌ๋‚ธ๋‹ค.
  • Normal pressing: ์ ‘์ด‰ ์˜์—ญ์— ์ง‘์ค‘๋œ ๋Œ€์นญ ๋ฒ•์„  ์••๋ ฅ + ์ค‘์‹ฌโ†’์ฃผ๋ณ€์œผ๋กœ ํผ์ง€๋Š” ๋ฐฉ์‚ฌ ๋Œ€์นญ ์ ‘์„  traction. ๋ถ€ํ”ผ ๋ณด์กดยทPoisson ํšจ๊ณผ(์ˆ˜์ง ์••์ถ•์ด ์ธก๋ฐฉ ํŒฝ์ฐฝ์„ ์œ ๋ฐœ)๋ฅผ ๋ฐ˜์˜.
  • Lateral translation(sliding): ์‘๋ ฅ์žฅ์˜ ๋Œ€์นญ ๊นจ์ง โ€” ๋ฒ•์„  ์••๋ ฅ์ด ์ง„ํ–‰ ๋ฐฉํ–ฅ leading edge๋กœ ์ ๋ฆฌ๊ณ (์ „๋ฐฉ ์ ค ์ถ•์ ), ์ ‘์„  ๋ฒกํ„ฐ๋Š” ์Šฌ๋ผ์ด๋”ฉ ๋ฐ˜๋Œ€ ๋ฐฉํ–ฅ์œผ๋กœ ๊ท ์ผ ์ •๋ ฌ(์ „์—ญ ๋งˆ์ฐฐ ์ €ํ•ญ). leading edge์—์„  ๊ตญ์†Œ ๋ฌผ์งˆ ํ๋ฆ„์œผ๋กœ ๋ฐฉ์‚ฌ ํ™•์‚ฐ ๊ฒฝํ–ฅ.
  • Axial rotation(torsion): ๋ฒ•์„ ์€ ๋Œ€์นญ ์œ ์ง€, ์ ‘์„ ์€ ํšŒ์ „ ๊ฒฝ๋กœ์— ์ •ํ™•ํžˆ ์ ‘ํ•˜๋Š” vortex ํ˜• ๋ฒกํ„ฐ์žฅ โ€” ๋‹ค์ถ• ์‘๋ ฅ ์„ฑ๋ถ„์„ ๋ถ„๋ฆฌ(decouple)ํ•˜๋Š” ๋Šฅ๋ ฅ์„ ์‹œ์—ฐ.

์ •๋Ÿ‰ ๊ฒ€์ฆ์ด ์•„๋‹ˆ๋ผ ์ •์„ฑ ์‹œ๊ฐํ™”๋ผ๋Š” ์ ์€ ์งš์–ด๋‘˜ ๋งŒํ•˜๋‹ค. โ€œ๋ฌผ๋ฆฌ์ ์œผ๋กœ ๊ทธ๋Ÿด๋“ฏํ•œ ํž˜์žฅ์ด ๋‚˜์˜จ๋‹คโ€๋Š” ๊ฒƒ์„ ๋ณด์ด์ง€๋งŒ, ์ด traction ์ž์ฒด์˜ ์ •ํ™•๋„๋ฅผ ์‹ค์ธก 6D ํž˜๊ณผ ์ง์ ‘ ๋Œ€์กฐํ•˜์ง€๋Š” ์•Š๋Š”๋‹ค(๊ฒ€์ฆ์€ ์ด๋ฏธ์ง€ SSIM ์ชฝ).

๋‹ค์ค‘ ์„ผ์„œ ํ™•์žฅ์„ฑ


๋‹ค์ค‘ ์„ผ์„œ ํž˜์žฅ ๊ฒ€์ฆ(Fig. 8) โ€” ๊ตฌํ˜• indenter ์ ‘์ด‰. ํ–‰: (์œ„) GelSight Mini, (์ค‘) DIGIT, (์•„๋ž˜) 9DTact. ์—ด: ์‹œ๋ฎฌ ์žฅ๋ฉด / ์ ์‘ ๋ฉ”์‹œ / ๋ฒ•์„  ์••๋ ฅ / ์ ‘์„  traction. 9DTact๋Š” soft ๋ฐ˜ํˆฌ๋ช… base + stiffer black surface์˜ ์ด์ค‘์ธต์œผ๋กœ ๋ชจ๋ธ๋ง.

์„ธ ์ฃผ๋ฅ˜ ์„ผ์„œ์— ๋Œ€ํ•ด geometry๋ณ„ ์ ์‘ ๋ฉ”์‹œ๋ฅผ ์ž๋™ ์ƒ์„ฑํ•ด ๊ตฌํ˜• indenter ์ ‘์ด‰์„ ์‹œ๋ฎฌ๋ ˆ์ด์…˜ํ–ˆ๋‹ค. ๋ฒ•์„  ์••๋ ฅ์€ ์ ‘์ด‰ ์ค‘์‹ฌ์— ์ง‘์ค‘ ํ›„ ๋ฐฉ์‚ฌ ๊ฐ์‡ , ์ ‘์„  traction์€ Poisson ํšจ๊ณผ๋กœ ๋ฐฉ์‚ฌ ํ™•์‚ฐ โ€” geometry๊ฐ€ ๋‹ฌ๋ผ๋„ ์„ผ์„œ๋ณ„ mechanical ์‘๋‹ต์„ ์žก์•„๋‚ธ๋‹ค๊ณ  ๋ณด๊ณ ํ•œ๋‹ค. ์ƒˆ ์„ผ์„œ ์ถ”๊ฐ€๋Š” โ€œgeometry + calibration ํŒŒ๋ผ๋ฏธํ„ฐ๋งŒ ์ œ๊ณตโ€ํ•˜๋ฉด ๋œ๋‹ค๋Š” ๋ชจ๋“ˆ์‹ ์„ค๊ณ„๊ฐ€ ๊ฐ•์ ์œผ๋กœ ์ œ์‹œ๋œ๋‹ค.


์‹ค๋ฌผ vs ์‹œ๋ฎฌ ๋‹ค์ค‘ ์„ผ์„œ(Fig. 9) โ€” GelSight Mini(์ขŒ)ยทDIGIT(์šฐ), ๊ฐ 5๊ฐœ ์‹œํ—˜ ๋ฌผ์ฒด. ๊ฐ ์—ด: ์‹ค์ œ(์ƒ)/TaCauchy ์‹œ๋ฎฌ(์ค‘)/ํ”ฝ์…€ ์ฐจ์ด(ํ•˜). ๋…ผ๋ฌธ์€ GelSight์˜ ๋งˆ์ปค ํŒจํ„ด๊ณผ DIGIT ํŠน์œ ์˜ ์™ธ๊ด€๊นŒ์ง€ ์žฌํ˜„ํ–ˆ๋‹ค๊ณ  ์ ๋Š”๋‹ค.

๋‚ด๋ถ€ ์กฐ๋ช… ์›๋ฆฌ ์„ผ์„œ(GelSightยทDIGIT)์— ๋ฌผ๋ฆฌ ์ œ์•ฝ ๊ด‘ํ•™ ๋ Œ๋”๋ฅผ ์ ์šฉํ•ด 5๊ฐœ ์‹œํ—˜ ๋ฌผ์ฒด(๋‚ ์นด๋กœ์šด ์—ฃ์ง€~๋งค๋ˆํ•œ ๊ณก๋ฅ )๋กœ ๊ฒ€์ฆ: GelSight Mini SSIM 0.9277ยทPSNR 22.45 dB, DIGIT SSIM 0.9215ยทPSNR 25.42 dB. ์ฐจ์ด๋Š” ์ฃผ๋กœ ์กฐ๋ช…ยท์žฌ๋ฃŒ ๊ฒฐํ•จ์ด ๋ผ๋Š” ๊ฒฝ๊ณ„ ์˜์—ญ์— ์ง‘์ค‘๋œ๋‹ค.

๋น„ํŒ์ ์œผ๋กœ ๋ณด๋ฉด

๊ฐ•์ 

  • ์˜ฌ๋ฐ”๋ฅธ supervision์„ ๊ฑฐ์˜ ๊ณต์งœ๋กœ: ์‘๋ ฅ์„ ๋จผ์ € ํ’€์–ด ์••๋ ฅยท์ „๋‹จ traction์„ ๋ถ€์‚ฐ๋ฌผ๋กœ ์–ป๋Š” ์„ค๊ณ„๊ฐ€ ๊น”๋”ํ•˜๋‹ค. ๊ด‘ํ•™ ๋ฐฉ์‹์—” ์›์ฒœ์ ์œผ๋กœ ์—†๋Š” ํž˜ ground truth๋ฅผ ์ถ”์ถœ <1 ms๋กœ ์ œ๊ณตํ•œ๋‹ค๋Š” ์ ์€ downstream force-aware ์ •์ฑ… ํ•™์Šต์— ์‹ค์งˆ์  ๊ฐ€์น˜๊ฐ€ ์žˆ๋‹ค.
  • ๋ฌผ๋ฆฌ-๊ด‘ํ•™ ๊ฒฐํ•ฉ์˜ ์ผ๊ด€์„ฑ: FEM ๋ณ€ํ˜• ๋ฉ”์‹œ๋ฅผ ๊ด‘ํ•™ ๋ Œ๋”์˜ ๋ฌผ๋ฆฌ ๊ฒฝ๊ณ„๋กœ ์žฌ์‚ฌ์šฉํ•ด Taxim๋ฅ˜์˜ ๊ด€ํ†ต ์•„ํ‹ฐํŒฉํŠธ๋ฅผ ๊ตฌ์กฐ์ ์œผ๋กœ ์ œ๊ฑฐํ•œ๋‹ค. โ€œ์ •ํ™•ํ•œ ํž˜โ€๊ณผ โ€œ์‚ฌ์‹ค์  ์ด๋ฏธ์ง€โ€๋ฅผ ํ•œ ์‘๋ ฅ์žฅ์—์„œ ๋™์‹œ์— ์–ป๋Š” ํ†ตํ•ฉ์ด ์„ค๋“๋ ฅ ์žˆ๋‹ค.
  • ์ƒํƒœ๊ณ„ ์ ํ•ฉ์„ฑ๊ณผ ์‹ค์ œ ๊ณต๊ฐœ: Isaac Sim/Lab ์•ˆ์— ํ†ตํ•ฉ๋ผ 60 ๋ณ‘๋ ฌ 555 FPS๋ฅผ ๋‚ด๊ณ , ํ•ต์‹ฌ ๊ธฐ์—ฌ์ธ ์‘๋ ฅ ์ถ”์ถœ์ด ๋ณ‘๋ชฉ์ด ์•„๋‹˜์„ ์„ฑ๋Šฅ ๋ถ„ํ•ด๋กœ ๋ณด์˜€๋‹ค. ๊ทธ๋ฆฌ๊ณ  ๋ง๋ฟ์ด ์•„๋‹ˆ๋ผ ์ฝ”๋“œ๊ฐ€ MIT๋กœ ์ „์ฒด ๊ณต๊ฐœ๋ผ ์žˆ๋‹ค โ€” ์„ค์น˜ยท์žฌํ˜„ ๊ฐ€์ด๋“œ(REPRODUCTION.md), Docker, LFS ์—์…‹, ์„ผ์„œ 3์ข… ๋ฐ๋ชจ/๋ฒค์น˜๋งˆํฌ ์Šคํฌ๋ฆฝํŠธ, Isaac Lab RL ํƒœ์Šคํฌ๊นŒ์ง€ ๋“ค์–ด ์žˆ๋‹ค. Isaac ๋ฐ–์— ์žˆ๋Š” TacIPCยทDIFFTACTILE ๋Œ€๋น„ ์ง„์ž… ์žฅ๋ฒฝ์ด ํ™•์‹คํžˆ ๋‚ฎ๋‹ค.
  • ๊ฒ€์ฆ๋œ ์ถฉ์‹ค๋„์™€ ํ™•์žฅ์„ฑ: ํ†ต์ œ๋œ ์‹คํ—˜์—์„œ SSIM 0.93+๋ฅผ ์ •๋Ÿ‰ ๊ฒ€์ฆํ•˜๊ณ , ์„ธ ์ด์ข… ์„ผ์„œ๋กœ ํ™•์žฅ์„ฑ์„ ๋ณด์˜€๋‹ค. contact-aware ์ ์‘ ๋ฉ”์‹œ๋Š” ๋น„์šฉ-์ •ํ™•๋„ ๊ท ํ˜•์˜ ๊ตฌ์ฒด์  ์ˆ˜์น˜(7.35ร— ๋ฐ€๋„)๋ฅผ ์ œ์‹œํ•œ๋‹ค.

์•ฝ์ ยทํ•œ๊ณ„

  • ํž˜ ์ž์ฒด์˜ ์ •๋Ÿ‰ ๊ฒ€์ฆ ๋ถ€์žฌ: ์ด ํ”„๋ ˆ์ž„์›Œํฌ์˜ ์ •์ฒด์„ฑ์€ โ€œ์‹ ๋ขฐํ•  ํž˜โ€์ธ๋ฐ, ์ •์ž‘ ์ •๋Ÿ‰ ๊ฒ€์ฆ(SSIM/PSNR)์€ ์ „๋ถ€ ์ด๋ฏธ์ง€ ์œ ์‚ฌ๋„๋‹ค. 6์ถ• F/T ์„ผ์„œ๋กœ ์ธก์ •ํ•œ F_z๋Š” ์‹œ๋ฎฌ์„ ๋งž์ถ”๋Š” ๊ฒฝ๊ณ„์กฐ๊ฑด์œผ๋กœ ์“ฐ์ผ ๋ฟ, ์ถ”์ถœ๋œ tractionยท์ „๋‹จ์žฅ์˜ ์ •ํ™•๋„๋ฅผ ์‹ค์ธก 6D ํž˜๊ณผ ์ง์ ‘ ๋Œ€์กฐํ•˜์ง€ ์•Š๋Š”๋‹ค. ์ ‘์ด‰ ๋ชจ๋“œ ๋ถ„์„(Fig. 7)๋„ ์ •์„ฑ์ ์ด๋‹ค. โ€œfirst-principle์ด๋ผ ์‹ ๋ขฐํ•  ๋งŒํ•˜๋‹คโ€๋Š” ์ฃผ์žฅ์€ ์•„์ง ์ด๋ฏธ์ง€ ์ธก ๊ฐ„์ ‘ ์ฆ๊ฑฐ์— ์˜์กดํ•œ๋‹ค.
  • ๋ณ‘๋ ฌ์„ฑ์˜ ์‹ค์ œ ํ•œ๊ณ„: 555 FPS๋Š” ์ธ์ƒ์ ์ด๋‚˜ 60 ๋ณ‘๋ ฌ์— ๊ทธ์นœ๋‹ค. ์ €์ž ์Šค์Šค๋กœ โ€œ๊ณ ํ•ด์ƒ๋„ FEM์˜ ์—ฐ์‚ฐ ๋ถ€๋‹ด์ด ์ดˆ๊ณ ์† ์ •์ฑ… ํ•™์Šต์— ํ”ํžˆ ์š”๊ตฌ๋˜๋Š” ๋Œ€๊ทœ๋ชจ ๋ณ‘๋ ฌํ™”๋ฅผ ์ œ์•ฝํ•œ๋‹คโ€๊ณ  ์ธ์ •ํ•œ๋‹ค โ€” ๊ฐ™์€ IPC ๊ณ„์—ด์ธ Taccel์ด 4000+ ํ™˜๊ฒฝ์„ ๋‚ด์„ธ์šฐ๋Š” ๊ฒƒ๊ณผ ๋Œ€๋น„๋œ๋‹ค. downstream RL ์ ์šฉ์€ future work๋กœ ๋‚จ์•˜๋‹ค.
  • ์žฌ๋ฃŒ ๋ณด์ •: ์‹ค์ œ ์ ค์€ ๋งˆ๋ชจยทํžˆ์Šคํ…Œ๋ฆฌ์‹œ์Šค ๋“ฑ ์‹œ๋ณ€ ๋ฌผ์„ฑ์„ ๊ฐ–๋Š”๋ฐ ์ด๋ฅผ ์—ฐ์†์ ์œผ๋กœ ๋ชจ๋ธ๋งํ•˜๊ธฐ ์–ด๋ ต๋‹ค(์ €์ž ์ธ์ •). ๋‹จ์ผ Stable Neo-Hookean + ๊ณ ์ • ํŒŒ๋ผ๋ฏธํ„ฐ๊ฐ€ ๋‹ค์–‘ํ•œ ์„ผ์„œยท๋…ธํ™” ์ƒํƒœ๋ฅผ ์–ผ๋งˆ๋‚˜ ๋Œ€ํ‘œํ•˜๋Š”์ง€๋Š” ๋ฏธ๊ฒ€์ฆ.
  • ๊ฒ€์ฆ ๊ทœ๋ชจ: ๋ฌผ๋ฆฌ ๊ฒ€์ฆ์€ ๋‹จ์ผ ํ˜•์ƒ(์›ํ†ต) indenterยท์ˆ˜์ง ๊ฐ€์••ยท6 trial๋กœ ์ข๋‹ค. ์ „๋‹จยทํšŒ์ „์ด ํฐ ๋™์  ์ ‘์ด‰, ๋‹ค์–‘ํ•œ ๋ฌผ์ฒด์—์„œ์˜ SSIM์€ Fig. 9์˜ ์ •์„ฑ ๋น„๊ต ์™ธ์—” ์ œํ•œ์ ์ด๋‹ค. ์ ์‘ ๋ฉ”์‹œ ํŒŒ๋ผ๋ฏธํ„ฐ(15% ๋‘๊ป˜ยทinner radius ๋“ฑ)์˜ ๋ฏผ๊ฐ๋„ ๋ถ„์„๋„ ์—†๋‹ค.
  • ablation ๋ถ€์žฌ: ๋…ผ๋ฌธ์— ๊ธฐ์—ฌ ๋ชจ๋“ˆ์„ ๋ถ„๋ฆฌ ๊ฒ€์ฆํ•˜๋Š” ablation์ด ํ•˜๋‚˜๋„ ์—†๋‹ค. ๋ฌผ๋ฆฌ ์ œ์•ฝ ๊ด‘ํ•™ ๋ Œ๋”๋ง์ด Taxim๋ฅ˜ ๊ด€ํ†ต ์•„ํ‹ฐํŒฉํŠธ๋ฅผ ์‹ค์ œ๋กœ ์–ผ๋งˆ๋‚˜ ์ค„์ด๋Š”์ง€(before/after ๋น„๊ต ์—†์Œ), ์ ์‘ ๋ฉ”์‹œ(7.35ร— ๋ฐ€๋„)๊ฐ€ ํž˜ยท์ด๋ฏธ์ง€ ์ •ํ™•๋„๋ฅผ baseline 661 tet ๋Œ€๋น„ ์–ผ๋งˆ๋‚˜ ๊ฐœ์„ ํ•˜๋Š”์ง€ ์ˆ˜์น˜๊ฐ€ ์—†๋‹ค. 7.35ร—๋Š” ๋ฉ”์‹œ ๋ฐ€๋„๋ผ๋Š” ์ž…๋ ฅ๊ฐ’์ด์ง€ ์ •ํ™•๋„ ์ด๋“์ด๋ผ๋Š” ๊ฒฐ๊ณผ๊ฐ’์ด ์•„๋‹ˆ๋‹ค.
  • downstream ๋ฏธ์‹ค์ฆ: ์ดˆ๋กยท๊ฒฐ๋ก ์ด โ€œforce supervision for downstream robotic manipulationโ€์„ ๋‚ด์„ธ์šฐ์ง€๋งŒ, ์‹ค์ œ RL ์ •์ฑ… ํ•™์Šต์ด๋‚˜ sim-to-real ์ „์ด ์‹คํ—˜์€ ์—†๋‹ค(๊ฒฐ๋ก ์—์„œ ํ–ฅํ›„ ๊ณผ์ œ๋กœ ๋ช…์‹œ). ๊ฐ€์น˜ ๋ช…์ œ์˜ ๋งˆ์ง€๋ง‰ ํ•œ ์นธ์ด ๋น„์–ด ์žˆ๋Š”๋ฐ, ์ด ์นธ์ด ์–ผ๋งˆ๋‚˜ ํฐ์ง€๋Š” ์ด‰๊ฐ pushing sim2real RL ๋ฆฌ๋ทฐ์ฒ˜๋Ÿผ ์‹ค์ œ๋กœ ๊ทธ ์ „์ด๋ฅผ ๋ถ™๋“ค๊ณ  ์”จ๋ฆ„ํ•œ ์ž‘์—…๋“ค์„ ๋ณด๋ฉด ์ง์ž‘์ด ๊ฐ„๋‹ค โ€” ์‹œ๋ฎฌ๋ ˆ์ดํ„ฐ์˜ ํž˜์žฅ ์ •ํ™•๋„์™€ ์ •์ฑ…์˜ sim2real ์„ฑ๊ณต์€ ๋ณ„๊ฐœ์˜ ๋ฌธ์ œ๋‹ค.

๊ด€๋ จ ์—ฐ๊ตฌ์™€์˜ ์ž๋ฆฌ ๋งค๊น€

TaCauchy๋Š” VBTS ์‹œ๋ฎฌ๋ ˆ์ด์…˜์˜ ๊ด‘ํ•™โ†”๏ธŽFEM ์ŠคํŽ™ํŠธ๋Ÿผ์—์„œ โ€œIsaac ํ†ตํ•ฉ + ์™„์ „ํ•œ ํž˜ ๊ณ„์‚ฐโ€ ์ฝ”๋„ˆ์— ์ž๋ฆฌํ•œ๋‹ค.

  • ๊ด‘ํ•™ ๊ธฐ๋ฐ˜ baseline์ธ TACTO ๋ฆฌ๋ทฐ๊ฐ€ ๋ฐ”๋กœ TaCauchy๊ฐ€ โ€œ์ด๋ฏธ์ง€๋Š” ๋งŒ๋“ค์–ด๋„ ํž˜์€ ๋ชป ์ค€๋‹คโ€๊ณ  ๋Œ€๋น„์‹œํ‚ค๋Š” ๋Œ€์ƒ์ด๋‹ค โ€” TaCauchy๋Š” ์‘๋ ฅ์„ ๋จผ์ € ํ’€์–ด ๊ทธ ํ•œ๊ณ„๋ฅผ ๋„˜์œผ๋ ค ํ•œ๋‹ค.
  • ๋ฐ”๋กœ ์œ„ ์กฐ์ƒ์€ TacEx ๋ฆฌ๋ทฐ๋‹ค(๋…ผ๋ฌธ [8]). ์ €์ž๋“ค์ด โ€œTacEx์˜ ํ†ตํ•ฉ ์ ‘๊ทผ ์œ„์— ์Œ“๋Š”๋‹คโ€๊ณ  ๋ช…์‹œํ•˜๊ณ , ๊ณต๊ฐœ ๋ ˆํฌ๋„ ์‹ค์ œ๋กœ TacEx ์ฝ”๋“œ๋ฒ ์ด์Šค์˜ ํ™•์žฅ์ด๋‹ค. TacEx๊ฐ€ GIPC ์†Œํ”„ํŠธ๋ฐ”๋”” + Taxim/FOTS ๊ด‘ํ•™์„ Isaac Sim์— ์ฒ˜์Œ ๋ถ™์˜€๋‹ค๋ฉด, TaCauchy๋Š” ๊ทธ ์ž๋ฆฌ์— ์™„์ „ํ•œ ์‘๋ ฅ ์ถ”์ถœยท๋ถ„ํ•ด๋ฅผ ์–น์—ˆ๋‹ค. ์ด ๋ฆฌ๋ทฐ์—์„œ ๊ฐ€์žฅ ์ง์ ‘์ ์ธ ๊ณ„๋ณด๋‹ค.
  • ๊ฐ™์€ Isaac ์ƒํƒœ๊ณ„์˜ ๋ฉ€ํ‹ฐ์„ผ์„œ ํ†ตํ•ฉ ์ƒ์„ฑยท๋ฒค์น˜๋งˆํ‚น ํ”Œ๋žซํผ UniVTAC ๋ฆฌ๋ทฐ์™€ ์ง์ ‘ ๊ฒฝ์Ÿยท๋ณด์™„ ๊ด€๊ณ„๋‹ค(๋…ผ๋ฌธ [10]์œผ๋กœ ์ธ์šฉ). UniVTAC๊ฐ€ ํ†ตํ•ฉ ์ƒ์„ฑยท๋ฒค์น˜๋งˆํ‚น์— ๋ฌด๊ฒŒ๋ฅผ ๋‘”๋‹ค๋ฉด, TaCauchy๋Š” first-principle mechanical ground truth์— ์ง‘์ค‘ํ•œ๋‹ค.
  • ๊ฐ™์€ IPC ๊ณ„์—ด GPU ์ด‰๊ฐ ์‹œ๋ฎฌ๋ ˆ์ดํ„ฐ Taccel ๋ฆฌ๋ทฐ(๋…ผ๋ฌธ [11])๋Š” IPC + Affine Body Dynamics๋กœ 4000+ ๋ณ‘๋ ฌ์„ ๋‚ด์„ธ์šด๋‹ค. TaCauchy๊ฐ€ 60 ๋ณ‘๋ ฌ์— ๊ทธ์น˜๋Š” ๊ฒƒ๊ณผ ์ •ํ™•ํžˆ ๋ฐ˜๋Œ€ํŽธ ์ ˆ์ถฉ์ด๋‹ค โ€” Taccel์€ ๊ทœ๋ชจ๋ฅผ, TaCauchy๋Š” ์‘๋ ฅ์žฅ์˜ ์™„๊ฒฐ์„ฑ์„ ํƒํ–ˆ๋‹ค.
  • ์ „๋‹จ ๋ฏผ๊ฐ FEM ์‹œ๋ฎฌ๋ ˆ์ดํ„ฐ TactileLab ๋ฆฌ๋ทฐ์™€๋Š” โ€œFEM์œผ๋กœ ์ „๋‹จ๊นŒ์ง€ ์žก์•„ sim2realโ€์ด๋ผ๋Š” ๋ชฉํ‘œ๋ฅผ ๊ณต์œ ํ•˜๋˜, TaCauchy๋Š” Cauchy ์‘๋ ฅ ๋ถ„ํ•ด๋ผ๋Š” ์—ฐ์†์ฒด์—ญํ•™ ์ •๊ณต๋ฒ•์„ ํƒํ–ˆ๋‹ค.
  • ์ ‘์ด‰ ๋ฌผ๋ฆฌ ๊ฐ€์† ์ธก์—์„œ Hydroelastic-SDF ๋ฆฌ๋ทฐ์™€ ๊ฐ™์€ โ€œGPU ๋ณ‘๋ ฌ ์ ‘์ด‰ ์‹œ๋ฎฌโ€ ํ๋ฆ„์— ์†ํ•˜๋ฉฐ, ๋‘˜ ๋‹ค ์ •ํ™•ํ•œ ์ ‘์ด‰๋ ฅ๊ณผ ๋ณ‘๋ ฌ ์ฒ˜๋ฆฌ๋Ÿ‰์˜ ๊ท ํ˜•์„ ๋‹ค๋ฃฌ๋‹ค.
  • ์„ผ์„œ ์ธก์€ DIGIT ๋ฆฌ๋ทฐ์˜ ์ €๋น„์šฉ VBTS๋ฅผ ํ†ตํ•ฉ ๋Œ€์ƒ ์ค‘ ํ•˜๋‚˜๋กœ ๊ทธ๋Œ€๋กœ ์“ด๋‹ค.

์š”์•ฝ

TaCauchy๋Š” โ€œ์ด‰๊ฐ ์ด๋ฏธ์ง€๋ฅผ ํ‰๋‚ด๋‚ด์ง€ ๋ง๊ณ  ์‘๋ ฅ์„ ๊ณ„์‚ฐํ•˜๋ผโ€๋Š” ํ•œ ์ค„์„, WildMeshing contact-aware ์ ์‘ ๋ฉ”์‹œ + UIPC soft-body ์†”๋ฒ„ + Cauchy ์‘๋ ฅ ์ถ”์ถœ(\sigma=\tfrac1J PF^\top, t=\sigma n์˜ ๋ฒ•์„ /์ „๋‹จ ๋ถ„ํ•ด)์ด๋ผ๋Š” ์—ฐ์†์ฒด์—ญํ•™ ์ •๊ณต๋ฒ•์œผ๋กœ ๊ตฌํ˜„ํ•ด Isaac Sim์— ํ†ตํ•ฉํ–ˆ๋‹ค. ์‘๋ ฅ์„ ๋จผ์ € ํ’€์–ด ์••๋ ฅยท์ „๋‹จ traction์„ <1 ms์— ๋ถ€์‚ฐ๋ฌผ๋กœ ์–ป๊ณ , ๊ทธ ๋ณ€ํ˜• ๋ฉ”์‹œ๋ฅผ ๊ด‘ํ•™ ๋ Œ๋”์˜ ๋ฌผ๋ฆฌ ๊ฒฝ๊ณ„๋กœ ์žฌ์‚ฌ์šฉํ•ด ์ •ํ™•ํ•œ ํž˜๊ณผ ์‚ฌ์‹ค์  ์ด๋ฏธ์ง€๋ฅผ ํ•œ ์‘๋ ฅ์žฅ์—์„œ ํ•จ๊ป˜ ๋งŒ๋“ ๋‹ค. 60 ๋ณ‘๋ ฌ 555 FPS, ์‹ค๋ฌผ ๋Œ€๋น„ SSIM 0.93+๋กœ ์ถฉ์‹ค๋„๋ฅผ ๊ฒ€์ฆํ–ˆ๊ณ  GelSight MiniยทDIGITยท9DTact๋กœ ํ™•์žฅ์„ฑ์„ ๋ณด์˜€๋‹ค. ๋‹ค๋งŒ ์ •๋Ÿ‰ ๊ฒ€์ฆ์ด ์ด๋ฏธ์ง€ ์œ ์‚ฌ๋„์— ์น˜์šฐ์ณ ํž˜ ์ž์ฒด์˜ ์ •ํ™•๋„๊ฐ€ ์ง์ ‘ ๊ฒ€์ฆ๋˜์ง€ ์•Š์•˜๊ณ , ๋ณ‘๋ ฌ์„ฑ(60 ํ™˜๊ฒฝ)์ด ๋™๊ธ‰ IPC ์‹œ๋ฎฌ๋ ˆ์ดํ„ฐ์— ๋ชป ๋ฏธ์น˜๋ฉฐ, downstream RLยทsim-to-real์€ ๋ฏธ์‹ค์ฆ์œผ๋กœ ๋‚จ์•˜๋‹ค. ๊ทธ๋Ÿผ์—๋„ โ€œ๊ด‘ํ•™์˜ ์‚ฌ์‹ค์„ฑ๊ณผ FEM์˜ ๋ฌผ๋ฆฌ๋ฅผ Isaac ์•ˆ์—์„œ ํ•ฉ์น˜๋Š”โ€ ๋ฐฉํ–ฅ์— ์„ค๋“๋ ฅ ์žˆ๋Š” ํ•œ ์ˆ˜๋ฅผ ๋‘” ์ž‘์—…์ด๋‹ค.

Copyright 2026, JungYeon Lee