openage icon indicating copy to clipboard operation
openage copied to clipboard

Learn AoE graphics style and then autogenerate assets

Open kindl opened this issue 8 years ago • 22 comments

Hello there. We cannot use the original AoE assets. Have a look at this work https://github.com/junyanz/pytorch-CycleGAN-and-pix2pix which can turn zebras into horses and vice versa using learning. I thought it would be awesome to learn the graphical style of AoE assets and apply it to pictures of houses, castles and other buildings to generate game assets. The next step would be, to use it on satellite data to create maps similar to real world regions. This idea is a bit crazy and still out of reach, but openage is all about crazy ideas.

kindl avatar May 06 '17 22:05 kindl

We cannot use the original AoE assets.

do you mean that:

  • it's an intractable technical problem
  • the law prevents us ?

Birch-san avatar May 07 '17 21:05 Birch-san

It's a legal problem. We can use them, but we can't distribute them. In the long run, we want to have our own asset pack under a free license.

zuntrax avatar May 07 '17 22:05 zuntrax

do we face exactly the same legal problem with the AoEII assets also?

Birch-san avatar May 07 '17 23:05 Birch-san

are there legal implications for distributing assets generated by a program whose training set we are prohibited from distributing? would the training set be under source control?

Birch-san avatar May 07 '17 23:05 Birch-san

I have no idea how that is interpreted legally, but if my brain learned the style and I created new assets in Blender (wheeee #833) then it would be ok. So if my artificial brain learned the style it should be ok, I would say.

Then again there's stuff like https://en.wikipedia.org/wiki/Geschmacksmuster and inspiration vs infringement, artwork copyright, ...

The learned models would be under source control and the created assets are new, but inspired by the original work, and contributed to the openage-data repo.

TheJJ avatar May 08 '17 11:05 TheJJ

Yes, the AI totally has human rights.

VelorumS avatar May 08 '17 11:05 VelorumS

I'm pretty sure "Geschmacksmuster" doesn't apply here, because protecting all the assets that way would be rather expensive. We're probably only talking about usual copyright stuff.

zuntrax avatar May 08 '17 12:05 zuntrax

If the assets are created totally from scratch without using the original ones and if the AI only applies the style to it (instead of copying it), we shouldn't have severe legal problems. It is very difficult to secure a "Geschmacksmuster" because the style you want to protect has to be unique.

heinezen avatar May 08 '17 15:05 heinezen

Even if we have nice new graphics, the game data / gamelogic from the base game is still needed.

elnabo avatar May 08 '17 17:05 elnabo

@elnabo, that surprised me. I thought we wouldn't need any original game data once we are done with the assets. But I didn't think about non-media data. Are you sure we can't distribute the corresponding nyan files?

castilma avatar May 08 '17 17:05 castilma

But the nyan data would be built on copyrighted data (for AoE2, AoE1, ...).

elnabo avatar May 08 '17 18:05 elnabo

Well, I'm not a lawyer. I hoped that would be ok.

castilma avatar May 08 '17 18:05 castilma

I think it is okay. This is based 0. on intuition and 1. on http://www.xbox.com/en-us/developers/rules

TheJJ avatar May 08 '17 18:05 TheJJ

You can't reverse engineer our games to access the assets or otherwise do things that the games don't normally permit in order to create your Items.

Birch-san avatar May 08 '17 21:05 Birch-san

We didn't, others did. And so far we didn't accept Microsoft's licensing offer. Also, we're in Germany where reverse engineering for compatibility purposes is always allowed, unless we signed some contract that forbids us reversing. (related murrican law)

TheJJ avatar May 08 '17 22:05 TheJJ

And so far we didn't accept Microsoft's licensing offer.

What does this mean??

coffenbacher avatar May 14 '17 23:05 coffenbacher

That means that we did not make any use of the offer presented in http://www.xbox.com/en-us/developers/rules and therefore we don't have to comply any rules. Currently, the project operates completely without shipping any possibly copyrighted content.

I hope it remains that way when we create our own replacement assets, we'd have to ask someone that knows those thingsâ„¢ better though.

TheJJ avatar May 15 '17 09:05 TheJJ

@TheJJ The copyright laws applied to a project are usually the ones were the data is hosted or distributed. So we could (in theory) always fall back to relocating the repository to a country with the appropriate laws.

It's also advantageous that we a) are completely non-commercial and non-profit b) don't use anything from the original code base and c) are currently only supporting operating systems that Microsoft doesn't support with their product.

I've looked into the topic of EULAs a bit and it turns out that they are not legally binding in the EU. As long as we don't crack the game, disassemble and distribute it, we are totally fine.

heinezen avatar May 15 '17 18:05 heinezen

Actually, in EU you are allowed to reverse engineer a product in some cases. See this: http://europa.eu/rapid/press-release_IP-12-208_en.htm

janisozaur avatar May 15 '17 19:05 janisozaur

The only thing I'm currently unsure about and it would be awesome if somebody investigated is: when we create replacement assets in the same style, and replacement data with similar or equal names and values (a fucking Pikeman is a Pikeman that has 4 melee attack), is that any problem? I.e. can non-special names ("villager...") and values (hp=10) or the graphics style be subject to funny copyright laws?

TheJJ avatar May 16 '17 16:05 TheJJ

I can answer this:

  • Names: OK. AoE2 uses mostly hostorical (Chevalier,Mameluke,Paladin) or generic names (villager, scout, swordsman)). They are not covered by copyright law.
  • Values: OK. They fall into the category of ideas and are usually not covered by copyright law.
  • Replacement assets: Depends. If we copy the exact same style, it can be a problem because copyright covers the looks of a game. We are allowed to create replacement assets and even autogenerate them, but the question is whether we will have the right to distribute them. We may have to alter their looks a bit.

Relevant: § 69a-69f UrhG insb. §69d Abs. 3

heinezen avatar May 16 '17 21:05 heinezen

hey, it finally happened
https://twitter.com/neilsonks/status/1657502130595328000

Birch-san avatar May 14 '23 16:05 Birch-san