m3-org/avatar-interop

avatars, wearables, and animation interop research

avatar-interop's Issues

Aligning with Webaverse on this

When working on avatar interop problems I always circle back to Webaverse solving the hard parts

Here's a handful of recent and related issues being worked on the main app

• webaverse/app#2533
• webaverse/app#2532
• webaverse/app#2524
• webaverse/app#2519
• webaverse/app#2456
• webaverse/app#2547

I think studying and documenting Webaverse implementation for avatars, wearables, and animation interop is a good path

add a contributor guide

how can ppl contribute to the wiki / repo

3/22/22 Weekly meeting 5 Agenda

• Weekly news
  • Otherwise (yugalabs)
  • ENSavatar by Mekezzo
  • M3taloot teasers
• Interoperable avatars / wearables
  • Tubby pets
  • Super yetis
  • Mfers
  • Metatravelers
• Community infrastructure updates
  • Wiki updates
  • Call for POAPs
  • Gearing up with M3taloot

add new sample files

Wearables

• add metaversefiles
• add clo file
• add blender example
• add JSON from hyperfy grabbable

READMEs

• add readme in different folders like wearables

Prefab of avatars in repo

Make avatar switcher prefab (or multiple) with all the characters in the wiki for testing in VRchat

Docs: create a glb npc with multiple animations

Repost from Ash in M3 discord, we should post this into a docs page somewhere and link some other guides (like this one published by polygonal mind: https://www.polygonalmind.com/blog-posts/export-a-gltfglb-with-several-animations)

• roughly following https://www.donmccurdy.com/2017/11/06/creating-animated-gltf-characters-with-mixamo-and-blender/
• export from mixamo without animations and T-Pose
• new blender
• import FBX, select "Manual Orientation" and "Automatic Bone Orientation"
• rename animation to TPose
• select all (armature + meshes) and apply all transforms
• if mesh is offset in pose mode
  • select all bones and clear all trasnfroms (option GRS)
  • in animation editor insert keyframes for both frames, to make sure pose is updated
• do optimisations, eg:
  • resize textures and option+s to repack
  • fix transparency issues by removing alpha and using Opaque instead of Alpha Blend
• at this point exporting to GLB should look good in Hyperfy and not have any frustum issues
• adding animations
  • export as FBX
  • import to mixamo, textures wont show but thats fine
  • for each animation, download without skin
  • import FBX animation back into blender, ensuring "Manual Orienation" and "Automatic Bone Orient"
  • rename the animation to some clear like "Idle" or "Talk"
  • rename base armature "Character"
  • now delete the animation armatures, this will still keep the animations around
  • go to animation tab, switch Dope Sheet to Action Editor, select Character and switch the animations to play them
  • each animation needs to be "Push Down" so that it exports with the GLB
  • export GLB with animations, test here: https://gltf-viewer.donmccurdy.com/
  • BOOM!

Exploring the Polygon avatar / wearables ecosystem

Many virtual world crypto projects are using polygon for avatars and wearables, boasting strong network effects along with cheaper / faster transactions and mint fees which are super useful for lower cost accessories. It's worth diving into this ecosystem to see how it can become more interoperable.

• Webaverse
• Cryptovoxels
• Decentraland
• Sandbox
• Mona
• Spatial
• OnCyber
• NFT Worlds (rebooting)
• House of Kibaa
• Immersed
• Cryptoavatars

And that's just the social layer, tons of games are on Polygon as well. Would be nice to find an updated ecosystem map.

Creating flowcharts

Flow charts can help us visualize this space better and areas that can be improved
It'd be interesting to map out what an ideal creator flow looks like for max self expression, freedom / interop

Avatars
Flowcharts on creation of avatars and a rough look on how to bring them into worlds / apps

Wearables
How to attach custom wearables to your avatar

Document animation interop examples

Upload demos sharing mixamo animations between vrchat / webaverse
Create a documentation page on UGC animations in webaverse docs

To-do: NPCs dev log

Need to add more details, link demos, and open source code examples here: https://hackmd.io/pjXXP0WUTzyABdSsSBipXg

cross-over m3taloot hero shot

When Yuga labs dropped the Otherwise video the frame that contained all the other NFT cross-overs became the most talked about. The power of cameos / cross-overs in metaverse media is huge (see Ready Player One). This issue is to talk about the M3 equivalent by taking it one step further with interoperable wearables (m3taloot)

---

M3taloot

Have 3D avatars wearing the loot and posing in video / photo shoots to create a hero shot of something like a fun game, similar to South Park The Stick of Truth.

Here is an older concept art of m3taloot. We are thinking 9 characters for the new shot.

• Orion
• VRoid
• Bayc
• Meebit w/ vox version wearbles
• Cryptovoxels mannequin
• Metaani / Tubby cat / Cryptoad
• 0N1Force
• Upstreet
• Mfer
• Super yeti

I know that's 10, so we need to cut it down to max 9 and save the rest for future previews.

Then we manually rig avatars with m3taloot

Art team will pose / create the final art.

Add initial sample files

We need a shared library of assets to experiment with avatar interop together, lets gather a handful of avatars, wearables, and animation samples to prototype with or resources on where to get them:

• Avatars
  • Orion
  • Meebit
  • VRoid
  • Cryptovoxels
  • Upstreet
  • 0N1Force
  • Tubby cat
  • Y-bot
• Wearables
  • MetaFactory swag
  • M3taloot (glb model)
  • Sketchfab stuff (non-NFT good foil to have)
  • Cryptovoxels wearables (vox models)
• Animations
  • Mixamo
  • HEAT
  • PoseAI
  • Cryptovoxels dances
  • Webaverse

Feedback welcome / feel free to suggest more ideas

Wearable patches / pins for M3

Wanted to start a discussion to document adding patches / pins onto our avatars