There are two ways to construct a road: you can either set a predetermined paved path, or you can put down a lawn, observe the so called “desire paths” that people naturally wear down through the grass and pave those over into a proper road.

Now that niji 5 has been released for about over a month, we’ve had some time to observe usage statistics and prompting patterns. Just like the case with physical roads and lawns, people often wandered off the optimal usages that we’ve carefully prepared.

As model makers, we were curious what we could do with this data. As it turns out, the model we trained from the difference between “what we tuned niji to do” vs. “what people wanted to use niji for” was so interesting that we decided to release it as its own separate style.

We’ve served a full 4-course meal before with the style event, so we hope that you’ve saved some room for dessert.

The hidden vector of model quality

There is an interesting thing about model quality which cannot be demonstrated in pure pictorial output: it is the model’s willingness to draw what people ask for.

Consider this example: if we tune a model that draws very nice kakapos, but nobody ever asks for any kakapos, then it is about as effective as if we have never tuned a model that draws kakapos at all. The opposite is true: small details that we didn’t exactly balance feel like they’re a big part of the model when the users eagerly prompt for them.

Studying this interaction is part of an ongoing project that maps out user interests, which started with the niji 4 voting experiment in 🌹 The Study of Aesthetics.

Creating innovative styles from imagination

For example, this is a 3D style that became surprisingly popular upon the release of niji 5 expressive.

When we apply the aesthetic preference of the niji user base, we come out with a much more anime-flavored variant: based on what it observes from usage statistics, the model goes towards what the users want to see.

It’s interesting to note that this anime 3D style is not commonly found in the world of real art. All art starts in the mind of the creator and finishes in the mind of the viewer. Never has there been a time where this statement is more true.

A desire path is born!

The yet-unnamed new niji 5 style will be launching in approximately one week. Please look forward to it!

As always, thank you for taking this journey with us.

相关文章