Mattercraft’s new AI assistant is now live for everyone (yes, even the free trial comes with credits!). After a month of poking and prodding, I’ve picked the five workflows where Mattercraft AI genuinely saves you time (and a bit of sanity).
Steal these use cases to speed up your workflows and, more importantly, let me know what you’re using Mattercraft AI for. Watch the full video on our YouTube channel.
#1: Turn three.js snippets into live components
Goal
Apply a glass-like material from a Three.js demo to an object in your scene.
Steps:
- Start a new project with the World Tracking template.
- Replace the default model: open the Asset Browser, locate a chess-set model, and drag it into the hierarchy.
- Open the Three.js examples page, locate the “PhysicalTransmissionAlpha” demo, and copy the entire snippet.
- In Edit mode, select the pieces that should look transparent.
- Open the AI assistant, set it to Edit, and submit the prompt: ‘Apply this material to the chess pieces.’
Result
The assistant creates a material that mimics realistic glass. All shader parameters are exposed, so you can adjust roughness or transmission values inside the Inspector.
#2: Rapid-fire custom behaviours (plus fireworks)
Goal
Create a glowing orb that spins, pulses, and emits fireworks when tapped.
Steps:
- Insert a Sphere mesh, name it orb, and position it in the scene.
- In Edit mode, drag a glow reference image into the chat panel.
- Use the prompt: ‘Make the orb material match this image.’
- Adjust colour or intensity in the Inspector if needed.
- Still in Edit mode, ask: ‘When the user taps the orb, make it pulse and spin’.
- After the behaviour is generated, add a second prompt: ‘Trigger a particle explosion each time the orb is tapped’.
Result
The assistant builds a Timeline animation for scaling and rotation, adds a ParticleEmitter node, and wires the emitter to the tap event. No direct particle scripting is required.
#3: Character animation + UI in minutes
Goal
Switch between two dance animations on a Ready Player Me avatar using a custom button.
Steps:
- Import or create a Ready Player Me avatar that includes at least two dance clips.
- In Ask mode, request: ‘Play the first animation on start’.
- Verify playback in the Simulator.
- Ask: ‘Add a UI button that switches to the second animation when pressed’.
- The assistant will create a Button node and an accompanying script.
- To adjust the button’s look, create a styles.css file and begin typing a rule. The code editor provides autocomplete for common properties.
- For a simple entrance animation, prompt:’Animate the button so it slides up from the bottom with a small bounce’.
Result
Users see the first dance by default and can tap the button to trigger the second. All UI logic lives in one script, and Timeline keyframes handle the button motion.
#4: Debugging without the digging
Goal
Resolve reference errors in a particle explosion function
After refactoring a particle effect, I broke a few references. Instead of combing through logs, I asked: “Why am I getting errors?”
The assistant:
- Scanned the open script.
- Pointed out mismatched IDs.
- Offered to fix them—one click, done.
Result
Mattercraft AI scans the code, identifies invalid node IDs or missing imports, and updates the script automatically. You avoid manual hunting through the log output.
#5 One-prompt localisation
Goal
Create a multilingual splash screen without external localisation files.
Steps:
- Prepare a splash-screen mock-up in a design tool or as static markup.
- Paste the design into chat and request: ‘Build this layout in my scene’.
- Once the layout appears, ask: ‘Translate all text into French’.
- Confirm that the placement still looks correct.
You can then use the same prompt again to translate into multiple languages: “Translate all text into Chinese."
Result
The assistant rewrites each text node and adjusts spacing as needed for different languages. You can repeat the prompt for additional locales without new resource files. Perfect for quick demos across markets.
Key takeaways
- Speed through setup. Turn external snippets or designs into live components with a single prompt.
- Stay in context. All edits happen inside Mattercraft, so you keep full control of the project tree.
- Learn as you go. Swap to Ask mode any time to get a plain-language breakdown of the script you’re working on.
- Prototype globally. Built-in localisation means your POC is ready for user testing in multiple markets the same afternoon.
Your turn
Give Mattercraft AI assistant a spin, break things, and share what you build. Drop a link or a GIF in the XR Pioneers Discord because showing beats telling, every time.
Happy creating, see you in the comments!
– Abbie