Modern Creator
Matt Wolfe · YouTube

11 AI Breakthroughs You Didn't Know Existed

A tour of eleven under-the-radar releases, from directable text-to-speech and talking-photo video to world models, game-engine repaints, 3D reconstruction and a non-AI map generator.

Posted
2 weeks ago
Duration
Format
Review
educational
Views
162.9K
3.3K likes
Big Idea

The argument in one line.

The most interesting AI progress right now is in small research releases, and the biggest pattern is splitting jobs apart so a game engine handles the world while a video model only handles the look.

Who This Is For

Read if. Skip if.

READ IF YOU ARE…
  • A creator or developer who follows the weekly AI headlines and wants the smaller research releases that never make the big-lab news cycle.
  • Someone making audiobooks, game dialogue or character video who wants to know whether Drama 3 or OmniHuman 2.0 is worth testing, including real prices and hardware needs.
  • A game or 3D builder curious about world models, engine-plus-AI-reskin pipelines, and photo-to-mesh reconstruction.
SKIP IF…
  • You want deep technical benchmarks or hands-on tutorials. Most items get a two-minute demo reel walkthrough, not a test.
  • You only care about the major labs' flagship models. This video deliberately avoids them.
TL;DR

The full version, fast.

Matt Wolfe covers eleven lesser-known releases. Fish Audio Drama 3 lets you direct text-to-speech in plain English with bracketed notes, and OmniHuman 2.0 turns one photo plus audio into up to five minutes of talking video at 720p. Three world-model projects tackle the memory problem differently: WorldCrafter looks up past views by camera position, while Matrix Game 4.0 and Nvidia's StreamRender-H3 let a game engine hold the world and have a video model repaint it. T3lescope, GaussiAnimate and the non-AI WorldGacha round out 3D and world generation. Most come with real catches: heavy hardware, low resolution, or no public release.

Free for members

Chat with this breakdown — free.

Sign in and you get 23 free chat messages on us — ask for the hook, quote a framework, find the exact transcript moment, generate a markdown action plan. Bring your own key when you want unlimited.

Create a free account →
Chapters

Where the time goes.

00:00 – 00:47

01 · Under-the-radar intro

Sets up the video as a look at releases that missed the weekly news show.

00:47 – 04:25

02 · Fish Audio Drama 3

Text-to-speech directed in plain English with bracketed notes, plus scores, license and API pricing.

04:25 – 06:47

03 · OmniHuman 2.0

Single image plus audio becomes up to five minutes of talking video at 720p for 7 cents a second.

06:47 – 08:56

04 · WorldCrafter

Tencent's world model uses camera-position memory to stay consistent when you revisit a spot.

08:56 – 09:55

05 · ByteDance world model

Unreleased, unnamed demo that re-shoots a King of Comedy scene from new angles.

09:55 – 11:05

06 · Sponsor: OpenAI Dots

Sponsored segment on always-on agents used for YouTube analytics reporting.

11:05 – 14:28

07 · Matrix Game 4.0

A game engine holds the world while a video model repaints a low-poly frame.

14:28 – 16:47

08 · Nvidia StreamRender-H3

Same split, but the engine hands over a flat color-coded map and data-center GPUs do the rendering.

16:47 – 18:24

09 · Odyssey and the fruit fly brain

A simulated fly brain wired into Odyssey 3, plus a hands-on look at the Odyssey 3 demo.

18:24 – 20:13

10 · T3lescope

Coarse-to-fine generative photo-to-mesh reconstruction that beats Gaussian wrapping on detail.

20:13 – 21:28

11 · GaussiAnimate

Floating nodes layered on a skeleton to animate loose cloth and soft bodies.

21:28 – 23:32

12 · WorldGacha

A free, non-AI browser tool that generates random fictional regions and cities.

23:32 – 25:16

13 · Sign-off

Wolfe plans roughly one of these a month and points to his Friday news video and newsletter.

Atomic Insights

Lines worth screenshotting.

  • Fish Audio Drama 3 takes stage directions in square brackets inside the script, so you direct a voice like an actor instead of picking a preset emotion from a menu.
  • Drama 3 tops pronunciation scores yet does worse in blind listener preference, so reading hard words correctly is not the same as sounding best.
  • Fish Audio's API price is a launch discount of about $10 per million characters that jumps to $50 after November 12th, and the API can quietly fall back to older models and still bill you.
  • OmniHuman 2.0 extends single-shot talking video from 60 seconds to five minutes, and cuts the price from 12 cents to 7 cents per second, so a full five-minute clip is still about $21.
  • World models forget because they only remember the last few seconds of frames they drew, so anything that leaves the screen can vanish.
  • WorldCrafter fixes world-model memory by looking up past views by camera position and feeding the matching ones back to the generator.
  • Rebuilding a 3D point cloud from generated video is a consistency test: an inconsistent world reconstructs as mush, a consistent one gives clean geometry.
  • Matrix Game 4.0 stops asking the AI to remember the world and instead lets an ordinary game engine track everything while the video model only repaints a blocky low-poly frame.
  • A coding agent can write new rules into the game engine and update the video model's prompt, so the world changes mid-game without the AI inventing physics.
  • Each Matrix Game 4.0 model is about five billion parameters trained for one scene, outputs 480 by 864, and ships under Apache 2.0 with weights and inference code.
  • Nvidia's StreamRender-H3 feeds the video model a flat color-coded map with no lighting or textures, so swapping one reference image restyles the whole game.
  • Nvidia had Claude Code build a faster video decoder for StreamRender-H3, and a working version was running in the pipeline in about three hours.
  • StreamRender-H3 needs eight GB200 data-center GPUs at about 218 milliseconds per step, so it is photoreal but not something for a gaming PC.
  • T3lescope builds a whole scene at low detail first, then zooms into the areas that need more and refines them, which is where the name comes from.
  • GaussiAnimate adds floating nodes on top of a skeleton so loose clothing and soft bellies can jiggle and flow instead of moving like rigid bones.
  • WorldGacha is not AI at all: random numbers and math generate fictional maps and cities you can export as PNG, SVG or 3D object files.
Takeaway

Splitting the job beats asking AI to do everything.

WHAT TO LEARN

The common thread across these releases is dividing work between specialized parts, and checking the price, hardware and release status before getting excited.

02Fish Audio Drama 3
  • Directable text-to-speech lets you write stage directions in brackets and scope them to single words, but plan to generate several takes because output varies.
  • Check API defaults before you pay: Drama 3 can silently fall back to older models and still bill you, and its launch price rises fivefold after November 12th.
03OmniHuman 2.0
  • Single-photo talking video now reaches five minutes at 720p for about $21, but lip sync, shifting backgrounds and deepfake risk remain open problems.
04WorldCrafter
  • World models forget because they only remember recent frames. WorldCrafter fixes it with camera-position memory, tested by checking whether a rebuilt 3D point cloud comes out clean.
07Matrix Game 4.0
  • Letting a game engine own world state while a video model repaints it solves the vanishing-object problem and makes AI games a more realistic path.
  • Matrix Game 4.0 is runnable and commercially usable but narrow: one model per scene, five billion parameters, 480 by 864 output.
08Nvidia StreamRender-H3
  • Nvidia's color-map approach lets you restyle an entire game by swapping one reference image, at the cost of eight data-center GPUs and racing-only training.
  • Treat vendor benchmarks and demo reels as marketing: several of these projects have no public release, no code yet, or only the lab's own comparison scenes.
10T3lescope
  • T3lescope refines coarse-to-fine for sharper meshes than Gaussian wrapping but needs dozens to hundreds of photos and only rebuilds where the camera moved.
11GaussiAnimate
  • GaussiAnimate animates loose cloth and soft bodies by adding floating nodes to a skeleton, and needs a captured motion sequence first.
12WorldGacha
  • Not every cool tool is AI: WorldGacha generates fictional maps and cities from pure math and exports to PNG, SVG and 3D files you could reskin with AI.
Glossary

Terms worth knowing.

World model
An AI model that generates a video world you can move around in, rather than a fixed clip. The hard part is keeping the world consistent when you look away and back.
Open weight
A model whose trained parameters are published for download so you can run it yourself, often under a specific license with limits.
Quantized
A smaller version of a model stored at lower numeric precision, such as 4-bit, so it fits on a cheaper GPU at some cost in quality.
VRAM
The memory on a graphics card. Large models need enough of it to load, which is why a 36 billion parameter model asks for 32 to 46 GB.
Gaussian splatting
A method of reconstructing a 3D scene from many photos by fitting it to that specific scene. T3lescope is compared against it.
Mesh
A 3D surface made of connected triangles, the standard format game engines and 3D tools can use directly.
Rigging
Adding a skeleton and controls to a 3D character so it can be animated.
Point cloud
A set of 3D points reconstructed from images or video, used here to check whether a generated world stays geometrically consistent.
Resources

Things they pointed at.

Quotables

Lines you could clip.

11:26
“This one stops asking the AI to remember the world at all.”
Clear contrarian setup that explains the core idea in one line→ IG reel cold open↗ Tweet quote
12:24
“The engine handles the gameplay and the AI handles the look that's skinned over the gameplay.”
Tight one-sentence explanation of the engine plus repaint split→ newsletter pull-quote↗ Tweet quote
16:05
“They handed Claude Code the job of building a faster video decoder, and they had a working version running in about three hours.”
Concrete and surprising speed claim→ TikTok hook↗ Tweet quote
The Script

Word for word.

Read-along

Don't just watch it. Burn it in.

See every word as it's spoken — crank it to 2× and still catch all of it. The same dual-channel trick behind Amazon's Kindle + Audible.

So every week I like to make an end of week AI news breakdown video where I share everything that happened in the world of AI for the week. Usually those videos are very focused on some of the bigger labs. They're the ones that get most of the news.
OpenAI, Anthropic, Microsoft, Google, Nvidia, companies like that. However... There's often some really cool news that flies under the radar.
There's a lot of research going on and smaller tools that not as many people, including myself, are talking about right now. So in this video, I want to share some of the cooler things that I've come across recently that haven't made the bigger end of week news videos. Let me know in the comments if you like this style of video, and I'll probably make them more often and share some stuff that's not from the big labs.
But let's start here. with Fish Audio. Fish Audio released a model called Drama 3, and it's a text -to -speech model where you direct the performance in plain English instead of picking from like a menu of emotional presets.
So like most voice tools, they'll give you a drop down for happy, sad, angry, things like that. Drama three, however, it lets you write the direction the way you'd like explain it to an actor. You put it in square brackets right in the script.
So for example, here's some spoken text with no direction. I'm fine. Really?
Go on without me. And now here's one where there's some direction written in, barely holding it together, forcing a smile. I'm fine.
Really? Go on without me. And you can even pick specific words like right here.
They specifically tell it to whisper. Go on without me. I'm fine.
Really? Go on without me. So you can like scope and affect two specific words.
You could drop in sound effects, things like a small laugh, shaky breath, and you could put them exactly where you want them. I'm fine. Really?
Go on without me. You can even have multiple speakers with multiple voices. You were there that night.
I was home, asleep. Then why is your coat still wet? It rained.
They even licensed Uncle Roger's voice for the demo page, which is kind of hilarious. Haiya! Nephew, why you put ketchup in egg fried rice?
Fried rice need soy sauce, need MSG, need wok hei, not tomato sauce. Uncle Roger cannot watch this. If you've ever watched like any of the Uncle Roger videos, it's actually pretty spot on.
If we take a quick peek at artificial analysis here, we can actually see that fish audio drama three here scores the highest on pronunciation. So it's really good at pronouncing words, even scoring higher than 11 labs and SpaceX AI's text to speech model, which is one that I actually demoed in last week's news video. However, when looking at the arena leaderboard preference, which you know, sort of did a blind taste test where people listen to a bunch of different models and pick their favorites without knowing what model they were picking.
Well, it didn't quite do as well. So, you know, it reads hard words better than almost anything else. But a lot of people still prefer other voices.
It also appears to be open weight available on Hugging Face. It is a 36 billion parameter model, so you're going to need some pretty decent hardware in order to run it. People have reported that you need roughly 46 gigabyte VRAM card, or you can get away with 32 gigabytes with a community quantized four bit version, but neither of those are gonna run on like most laptops.
A couple other quick notes that I found about this one. So the license is free for commercial use, but only if you're making under half a million a year, which is probably a non -issue for most people. The API is about $10 per million characters right now, but that is a launch discount that jumps to $50 after November 12th and fish audio takes do vary.
So plan on generating a few and keeping the best one. And if you are going to use the API, double check that you set the model to drama three, because it often will quietly fall back to older models and you'll still get billed even if you're using the older models. So make sure you check that.
But if you head on over to fish .audio slash drama three, click try drama three for free. You can play around with it right now. And if you make audio books or game dialogue or anything with characters, probably worth trying out.
All right. While we're talking about voices, once you have that voice performance, you might want like a face to go with it. Well bite dance recently released Omni human 2 .0.
Now this model will take a single image and an audio track, and then it'll generate a video of the person talking or singing or acting it out. Now, this is the 2 .0 version. And the biggest difference is that the previous version topped out at just 60 seconds.
This one will allow you to go up to five minutes in one continuous shot. So you don't have to like stitch a bunch of short clips together and hope that, you know, you don't see the seams or hear the seams. So here's some examples.
The kingdoms called it a legend. Tonight, I make it real. And it even works with singing.
You can also add in text prompts to control camera moves or add things that weren't in the original photo. Now it generates in 720p resolution and it doesn't just have to be humans. It can work with like cartoon characters and animals and things like that as well.
Now, if I'm being totally honest, I still think these lip syncing models have a long way to go. When I watch a video with like an AI lip sync attached to it. it still just like isn't working for me.
We're getting closer and closer. I mean, like we're way better than we were a couple of years ago, but it still has a lot to be desired. I don't know.
What do you think? Let me know in the comments. As far as pricing goes, the price on this one dropped from 12 cents a second in the last model down to 7 cents per second in this model.
So if you are making a full five minute video. it's still gonna cost you about 21 bucks. Now, a few other quick things to note about this one.
Everything I'm showing you is ByteDance's own demo reel. And some early viewers did notice like background shifting around in their clip. Again, it's only 720p.
You're not gonna get 1080p or 4K out of this. And because this is only one photo plus any audio, there's some pretty obvious potential deep fake concerns with stuff like this. Although if you saw what I just saw, I don't think we have to worry about too many people being fooled just yet.
This one is available now through Byte Plus and through their API. All right, now let's talk about one of my more favorite topics recently. I've been absolutely loving these.
Let's talk about world models. So these are AI models that generate a video world that you can move around in. And Tencent's Arc Lab released one called World Crafter recently.
And this one starts from just a single image or a single line of text. Now, one of the big issues that we've had with world models is that if you're inside a world model and you look away from something and then turn back, a lot of times it's like gone or changed. The model only remembers the last few seconds of what it showed you.
And if you move around the room, everything kind of goes wonky. Now world crafters fix is a memory that you look up by camera position. So when you point the camera somewhere, it pulls the past views that match where you're looking and feeds those back to the generator.
So when you turn back to the original restaurant, it remembers what it saw the first time. So they prove it with this little trick here. They take the video the model generated and rebuild a 3D point cloud from it.
If the world were inconsistent, that 3D reconstruction would come out as just like mush. Instead, you get clean geometry and the camera path lines back up when it revisits a spot. It handles moving things too, like a character going out of frame.
And then later actually coming back into the frame. Like we can see with this horse video here where the camera takes the horse out of frame. And then when the camera pivots back around to the right, you can see that the horse is still there, even though it was moving now on their own benchmark of 145 different scenes, they say that it beats the other models they tested on revisit consistency and camera control.
But just keep in mind that that is their benchmark. So, you know, take that with a grain of salt. The code for this is available on GitHub right now, and there's even a version on Hugging Face that you can go and play around with right now.
In my own testing, though, telling it what to generate, it's kind of not the fastest thing in the world, but eventually it gets there. ByteDance also showed off their own version of a world model recently at an event in Beijing. My buddy Tim from Theoretically Media, he posted some footage that somebody sort of took.
during the event. So it's like this bootleg camera version. Now, the wildest demo they shared was they took a scene from Stephen Chow's movie, King of Comedy, and generated a brand new camera path through it.
It's like reshooting a shot that was filmed decades ago. You can now get new angles on that shot. You can also type a description to get a world, spawn a giant spoon, and then climb it and walk through a portal from a room into outer space.
Now, there is a catch, and that's that we can't use it yet it doesn't even have a public name yet and there's no release date and the only footage i've actually seen of it was from people who recorded it at this event as you know tim from theoretically media shared here so yeah we'll keep an eye on that one but It looks pretty impressive.
Real quick, before we get back to the video, I wanted to show you guys how I've been using this new feature, Dots from OpenAI. Now, I've talked about this in a recent AI news video, and since then, I've dug into it even more. Basically, Dots are these always -on AI agents that you can assign ongoing responsibilities to, and they keep on working on them even when you're not using ChatGPT anymore.
So for example, I've been using my Dot to help me with my YouTube analytics and updating them automatically every time I post. I connected it to my YouTube channel and it pulls views and engagement data to find patterns across my titles and topics and angles and post times. And I also have a shared space with my team where my dot keeps all this organized and creates new sub pages with weekly reports and video ideas based on what's working.
What's cool is that each dot has its own cloud computer and can use ChatGPT work and codecs to get things done. It's powered by GPT -6 Astra and learns by preferences so it can proactively suggest things without me having to ask.
So check it out in the link in the description and thanks so much to OpenAI for sponsoring this portion of today's video. All right, so we already saw two world models trying to fix the memory problem. Well, Skyworks Matrix Game 4 .0 takes a completely different approach.
This one stops asking the AI to remember the world at all. With a normal world model, the AI is doing everything. It's drawing the frame, but it's also the physics engine, the game rules, and the memory.
When something leaves the screen, the only record it ever existed is in the pixels the model already drew. And that's kind of why things tend to vanish. Matrix Game splits that job into two.
An ordinary game engine runs the game. It knows where every enemy is, what happens when you shoot something, what's behind you. It draws a cheap, blocky, low poly version of that scene.
Then the video model's only job is to repaint that blocky frame so it looks finished. So we can see in some of these models down here, on the right is what the game engine actually draws. On the left is what you see.
It's the same frame in the same moment. but the engine handles the gameplay and the AI handles the look that's skinned over the gameplay. Since this game engine is keeping track of everything, the world's not going to forget a pyramid behind you is still in the engine's map, whether the AI is drawing it back in or not.
Here's another example of a car game. You can see the blocky early rendered version and then AI putting its own graphics over the top. So the game engine only has to remember this and the AI does that.
There's also another piece. If you ask for something, the game rules don't cover a coding agent. writes new rules into the engine and updates the prompt the video model uses so the world can change mid -game without the ai having to invent new physics on the fly down here we can see three games a medieval castle shooter an ancient egypt shooter and city racing these long play sessions can run up to about a minute and a half without any sort of cuts now there are some catches each game has its own model and each one is about five billion parameters each trained just for that scene so it's not really a general make me any game model and the output is 480 by 864 so it's not anywhere near hd now the project page does talk about running on a single rtx 5090 but the model card does say there's no guaranteed frame rate consumer GPU memory fit or exact scene reconstruction.
So it may not totally fit into your GPU's memory and fast camera moves and long sessions still can cause some drift and the actual training code isn't included. but you can get the weights and the inference code under apache 2 .0 license so you can use them commercially now there is a hugging face space listed here for hugging apps matrix game 4 .0 so you should be able to play around with it here they do have some examples that are pre -cached in if you want to check out some of those examples now personally i think this engine plus like AI paint job or AI reskin is a pretty realistic path to AI games, at least more so than like asking a model to do everything.
Turns out Nvidia thinks so too. Next up, let's talk about something that came out of Nvidia called Stream Render H3. This is actually a pretty similar concept to what we just looked at.
It uses kind of that same split. Code runs the world and then a video model draws it in real time. The difference with this one is how little the game actually hands the AI.
Matrix Game gives the model a blocky 3D render. Nvidia gives it a color -coded map. Every pixel is a flat color that means road or grass or barrier or rival car.
There's no lighting, no textures. The video model actually draws everything you see. So here's the game engine's own view, the color map that it actually sends, and then the final frame that...
you know, the user sees. Now, because the map carries no like looks at all, you can actually restyle the whole game by swapping one reference image. We can see here that this is all the exact same drive, but when we fast forward a little bit, they can swap out the scene for anywhere they want and put the exact same drive in any different scene.
It's the same exact input what we see in the middle, just rendered out in different locations and different settings during the day and things like that. So one thing to notice here, this is kind of one of the hard parts for this model, is that the color map paints all of the rival cars the same exact color. So the model has to actually remember on its own which car is which and make sure to keep the same paint job across the various cars.
So a fun fact about this model is they actually handed Clodcode the job of building a faster video decoder for this. They gave it a speed target. And then they had a working version running in the pipeline in about three hours.
Now this does actually require some serious hardware. Each rendering step takes about 218 milliseconds. However, that's on eight GB 200 GPUs.
These are like the chips that they put into data centers from Nvidia. So this isn't something you're going to be running on your gaming PC, at least not for a while. Also, it's only been trained on racing so far.
That's why all of the demos are like race cars. So you can put this one kind of next to Matrix Game, which we just looked at, and you get a decent picture of the trade -off. Matrix Game aims for one consumer GPU at like lower resolution, where Nvidia is going for photo real, but on a rack of data center hardware.
Okay, this one's a little weird, but I wanted to show it off because it's also kind of cool. So Odyssey, the world model company that launched Odyssey 3 not too long ago, posted a clip saying they put a fruit fly brain inside their world model and now it flies around imagined worlds by itself. So this fly brain wasn't actually created by Odyssey.
It's a simulation built by a company called Eon Systems from a complete map of a fruit fly's brain. About 140 ,000 neurons and 50 million connections. Odyssey swapped out the virtual body that Brain was hooked up to and connected it to a camera moving through an Odyssey 3 world.
I don't know. I thought this one was fun, but there's like no paper, no code, no explanation of how the two are connected. And people in the comments did note that the fly never actually tries to land anywhere, which, you know, if it was a real fly, it probably would.
But it's brought up a lot of questions about, you know, simulation theory. Does this fly believe it's real and in a real world, but it's actually in a simulation? And if so, what are the implications of round simulation theory for, you know, humans and stuff?
We don't need to go down that rabbit hole though. While you can't actually play with this fly flying around inside of Odyssey 3, you can actually mess around with Odyssey 3 itself. Just head over to experience .odyssey .systems.
Give it a prompt of what you want it to create. And you can actually interact in this world. I am steering this fox right now.
I'm telling it to jump. I'm telling it which direction to go. I'm changing camera directions.
All of this is me actually controlling this. Pretty cool. All right, moving into 3D.
Preferred Networks, which is based in Japan, just released Telescope, which turns a set of photos of a place into a detailed 3D mesh, like from a single object all the way up to city blocks. Now, the usual way to get a high quality mesh from photos is to spend a long time fitting a model to that one specific scene. Telescope actually skips all that.
It's a generative model, so it's learned what surfaces generally look like, and it fills in gaps where you didn't get many photos. It also handles shiny and glass surfaces, which normally wreck photo based 3D. So the name is actually the method itself.
It builds the whole scene at low detail first, then zooms in on areas that need more detail and refines them like a telescope. The colors here show which level each surface came from. So if we look here, we have a Gaussian wrapping, which is sort of the standard method.
And if you look at this, it looks pretty good, but it's lacking a lot of detail. Now this is telescope and there's so much more detail here. So here's the original Gaussian wrapping and here is telescope.
Like it's a pretty big difference. Here's another example of Gaussian wrapping. And when I move this over, you could see their version and all of the details pop into focus now.
There is a little bit of a catch. You do need a lot of photos to achieve this. You can see this one took 256.
This one also took 256 right here. This one actually only took 56, which isn't too bad. And it can only rebuild what's inside the area your camera actually moved around.
This is one we don't have any sort of real access to. It does say the code is coming soon, but it looks like a pretty promising leap from what we got out of Gaussian Splatting. Here's another pretty cool one called Gauzy Animate.
And this one's actually used for animating 3D characters. It's designed for rigging up characters that are soft on the outside but rigid on the inside. So people in loose clothes, animals, or garments just on their own.
So a normal animation skeleton gives you control, but a loose shirt or like a dog's belly doesn't move like bones. So this adds on a whole bunch of other floating nodes on top. These additional floating nodes sort of capture all the jiggle and flow and the additional physics that come along with the, you know, the cloth or the material on top of the bones.
So we can see here that it finds the sort of shape. But then once it finds the shape, it actually puts a skeleton in the middle to figure out which parts need to actually be rigid. Once it figures out the points that need to be rigid, then it figures out what points need to sort of flow.
outside of the bones. So here's some other examples, like a clothed human, you have the skeleton, you've got the bones, you've got the skinning, and then everything combined where you can see the dress sort of flow. Now you do need a captured motion sequence of the character first.
It's not gonna just work from like a single image, but the code for this one is available on GitHub. and available for research use right now. All right, now this is the last one and it's actually not AI, but I just thought it was really cool.
So I wanted to share it anyway. This one's called World Gasha. I think I'm pronouncing that right.
And it's actually a free browser tool from a Japanese developer that actually creates random fictional regions that has mountains and rivers and coasts and towns and railways and rice paddies and almost anything you can imagine. And it draws it as like this manga style line art. Well, this one's actually not in that manga style line art.
This is a randomly generated city, but you can see if I add it with the lines, you kind of start to get that look. You can also put it on lines and tone and you get like a black and white version. You can put it on this like clay mode.
And this is, again, a randomly generated seed. I could reroll the dice and it's going to build me a whole new town or city or whatever. So now I can zoom in on this city that it just created.
We can also change it to. downtown it's going to build us a new city that looks like a downtown area or skyscrapers it'll build us a new city and these are again all randomly generated every single time and you could zoom into different views so let's say we want like a top view we can look straight down on this city like this maybe want an eye level view of central street and it actually brings us into the city where we can look around and wander around in this city Now imagine using something like this and then reskinning it with like one of the AI models we were looking at earlier.
You can build a pretty primitive looking city and then use AI image or video models to reskin it into something really realistic and maybe even build scenes for like films and animations and stuff. Again, this is not actually an AI model. There's no outside data.
It's just random numbers and math generating all of this. And if you do like a specific scene, you can actually export it as a PNG or an SVG or even a 3D object file. So you could theoretically create a world and then pull it into Unreal Engine and build a game inside of it or something like that.
I know I usually focus on AI stuff, but really, you know, the theme of my channel is just cool stuff that I come across online that I want to share. And sometimes it's not always AI. But that's what I got for you today.
Again, I make a news video every single Friday where I break down all of the news that came out in the AI world each week. But it's usually the biggest stories with the most impact on the most amount of people. I'm sort of trying to filter out the signal from the noise of everything that's going on and help you understand what.
might actually change what you do on a day -to -day basis. And in doing that, sometimes I miss some of these smaller research projects that don't get a ton of love and not a lot of people talk about. And I find all this stuff really cool and really fascinating.
And if you go back like three years on my channel, this is the type of stuff I used to talk about a lot more frequently until all of the big labs and big companies started having new launches every single week. And I kind of shifted more focused to that, but I want to get. back to my roots a little bit and make these videos a little bit more often.
So if you liked videos like this where I sort of dig and find some more underground things that are happening in the world of like AI and just cool tech research, let me know. I'll make sure to make more videos like this. I'm planning on making at least one of these a month because it's just really fun for me to dig in and find some of this stuff.
But again, that's what I got for you. If you like videos like this and you also want to be super looped in and informed on all the latest AI news, I'm going to keep up with all of that for you. I put out a video every Friday with all of the news.
I also put out a newsletter twice a week. You can subscribe for free over at futuretools .io. But thanks so much for hanging out with me, nerding out with me today.
There's a lot to nerd out on. I really, really appreciate you. And hopefully I'll see you in the next one.
The Hook

The bait, then the rug-pull.

Matt Wolfe usually covers the big labs in a Friday news video. This one is the other pile: eleven research projects and small tools with real demos, real prices and honest catches that never made the weekly cut.

Frameworks

Named ideas worth stealing.

11:26model

Engine plus AI repaint

  1. Game engine tracks world state
  2. Engine outputs a cheap stand-in frame
  3. Video model repaints the look
  4. Coding agent can rewrite rules

Split the job so code owns physics, rules and memory, and the video model only supplies visuals. This avoids objects vanishing when they leave the screen.

Steal forany AI-generated game or interactive world
07:21concept

Camera-position memory

WorldCrafter stores past views and retrieves the ones that match where the camera is pointing, then feeds them back to the generator so revisited places look the same.

Steal forkeeping generated scenes consistent over long camera paths
CTA Breakdown

How they asked for the click.

VERBAL ASK
24:51newsletter
“You can subscribe for free over at futuretools.io.”

Soft sign-off pitch after promising roughly one of these videos a month, tied to the Friday news video and twice-weekly newsletter.

Storyboard

Visual structure at a glance.

open
hookopen00:00
Drama 3
valueDrama 300:57
OmniHuman 2.0
valueOmniHuman 2.004:49
WorldCrafter
valueWorldCrafter07:29
sponsor
ctasponsor10:30
Matrix Game
valueMatrix Game11:31
StreamRender
valueStreamRender14:53
T3lescope
valueT3lescope19:04
sign-off
ctasign-off23:32
Frame Gallery

Visual moments.

One-click upgrade to your Google

Get more breakdowns in your search results

Add Modern Creator as a preferred source and Google shows you more of our breakdowns in Search, Top Stories, and AI Overviews. It only changes what you see, and you can undo it in your Google settings anytime.

Add to Preferred SourcesOpens your Google source preferences with us pre-loaded. Tick the box and you're done.
Watch next

More from this channel + related breakdowns.

38:09
Matt Wolfe · Interview

His AI Made 20 Reels Before Breakfast

Nate Herk walks Matt Wolfe through three Claude Code builds he runs daily: an editor trained on his own best reels, a debate panel of simulated business icons, and an Instagram account that runs itself.

October 28th