> Instead of expecting it to understand my requests, I almost always build tooling first to give us a shared language to discuss the project.
This is probably the key. I’ve found this to be true in general. Building simple tools that the model can use help frame the problem in a very useful way.
Honestly understanding and applying 3d transformations should be a new LLM benchmark. Three.js, OpenSCAD, even Nano Banano prompts. The moment you add that extra dimension any semblance of ‘intelligence’ goes right out the window. Every model out there seems to spin themselves in circles trying to logic through it with no success.
Gemini's best ability is it's 3d spatial reasoning. It's downright terrible at a lot of things (toolcalling is an absolute nightmare), but it consistently wins in stuff like 3d modeling, reasoning through 3d problems, and even 2d layout and animation tasks like the infamous pelican riding a bycicle benchmark
> Instead of expecting it to understand my requests, I almost always build tooling first to give us a shared language to discuss the project.
This is probably the key. I’ve found this to be true in general. Building simple tools that the model can use help frame the problem in a very useful way.
all i wanted was some opinions on if my bad idea would work, but it instead wrote me files for making my own sony earphones in 3ish parts.
and when i sewed it together, it worked!
that said, it did have full access to a mini CAD app, but i think it wrote all its own calculations inline