cloud icon indicating copy to clipboard operation
cloud copied to clipboard

How to search for a specific domain?

Open Sachinart opened this issue 1 year ago • 3 comments

Hi, absolutely awesome. Thank you very much for this amazing project.

I wanna search for a specific domain for an example: apple.com, So how I will know like in which file that exists or if that's not possible to search here then I have to download whole directory and then I have to search that using regex or any script?

Thank You!

Sachinart avatar Jun 12 '23 08:06 Sachinart

hi , you can use my tool :D cloud_data If it was useful, please give a star 😉

mrvcoder avatar Dec 29 '23 17:12 mrvcoder

@Sachinart, I agree, searching through csv is a pain. GitHub Code Search won't index this repo either.

@mhmdiaa should consider json too here's how to convert the csvfiles to json using csvtk

!# From a git cloned repo
find . -type f -name '*.csv' -exec sh -c 'csvtk csv2json "$1" > "${1%.csv}.json"' _ {} \;
!# This will generate a json file for each of the csv files

!# Or a Single Big one:
find . -type f -name '*.csv' -exec csvtk csv2json {} \; > "/tmp/csv2.json"

@mrvcoder love your tool, thanks for that. However, it's too much setup, and If I try with many domains (> 10), my system freezes and it takes a long time.

To solve all these problems, I have decided to make the data (Parsed & Cleaned) available at: https://pub.ajam.dev/datasets/sni-ip-ranges/

This also contains data from http://kaeferjaeger.gay/?dir=sni-ip-ranges

Azathothas avatar Mar 05 '24 20:03 Azathothas

@Azathothas thanks , actually my tool runs with github actions and for multiple domains I think it can handle it.

mrvcoder avatar Mar 05 '24 20:03 mrvcoder