model icon indicating copy to clipboard operation
model copied to clipboard

V1 model inference with NAIP

Open lillythomas opened this issue 1 year ago • 1 comments

The purpose of this PR is to create a notebook demonstrating how to run inference on new NAIP scenes. It may also serve the purpose of demonstrating sim search with the generated embeddings.

lillythomas avatar May 07 '24 07:05 lillythomas

Some current examples of similarity search results generated with 3600~ embeddings from NAIP sized at 256x256 and the v0.5.3/mae_v0.5.3_epoch-08_val-loss-0.3150.ckpt checkpoint.

Screenshot 2024-05-10 at 11 44 27 AM Screenshot 2024-05-10 at 11 43 02 AM Screenshot 2024-05-10 at 11 42 00 AM Screenshot 2024-05-10 at 11 42 39 AM Screenshot 2024-05-10 at 11 42 25 AM Screenshot 2024-05-10 at 11 48 44 AM Screenshot 2024-05-10 at 11 48 16 AM

These are all from the Bay area of California in 2020. Kind of crazy that it even captures similarity between open ocean surfaces with specifically visible white capping.

The notebook in this PR can be run to reproduce.

lillythomas avatar May 10 '24 18:05 lillythomas

@lillythomas I think this is a great example, and I think we should polish this up and add to the tutorials. I wanted to ask if you would be up for using stacchip for the data generation in the example 😊 . I made some small changes to stacchip to make it easier to use. Creating naip tiles is now just a few lines of code, see https://clay-foundation.github.io/stacchip/naip-tutorial/ .

yellowcap avatar Jun 11 '24 09:06 yellowcap

@yellowcap sounds good! I'll work on swapping the method for getting NAIP chips to use stacchip and request your review on it.

lillythomas avatar Jun 12 '24 02:06 lillythomas