amass icon indicating copy to clipboard operation
amass copied to clipboard

data_sources.disabled does not work in config.ini

Open bountyflow opened this issue 2 years ago • 2 comments

Running Amass with /opt/amass/amass enum -dir /opt/amass/graphdb -v -config /opt/amass/amassconfig.conf -d yahoo.com results in Amass using disabled datasources even when the config file contains the following lines:

# Are there any data sources that should be disabled?
[data_sources.disabled]
data_source = AlienVault
data_source = GitHub
data_source = Spyse
data_source = IPinfo
data_source = Robtex

Related amass.log:

...
20:47:55.559993 Spyse: https://api.spyse.com/v4/data/ip/2600:9000:223d:7c00:b:621d:79c0:93a1: Get "https://api.spyse.com/v4/data/ip/2600:9000:223d:7c00:b:621d:79c0:93a1": dial tcp: lookup api.spyse.com on 1.1.1.1:53: no such host
20:47:55.560186 Spyse: request to https://api.spyse.com/v4/data/ip/2600:9000:223d:7c00:b:621d:79c0:93a1 failed: Get "https://api.spyse.com/v4/data/ip/2600:9000:223d:7c00:b:621d:79c0:93a1": dial tcp: lookup api.spyse.com on 1.1.1.1:53: no such host
20:47:55.728585 IPdata: asn callback: <string>:54: attempt to index a non-table object(nil) with key 'asn'
stack traceback:
	<string>:54: in main chunk
	[G]: ?
20:47:55.752662 IPinfo: https://ipinfo.io/2600:9000:223d:7c00:b:621d:79c0:93a1/asn?token=: 403: 403 Forbidden
20:47:55.752741 IPinfo: get_asn request to service failed: 403: 403 Forbidden
20:47:59.587700 BGPTools: asn callback: <string>:91: attempt to index a non-table object(nil) with key 'lines'
stack traceback:
	<string>:91: in function 'netblocks'
	<string>:32: in main chunk
	[G]: ?
20:49:01.510728 Robtex: https://freeapi.robtex.com/ipquery/2600:9000:223d:7c00:b:621d:79c0:93a1: Get "https://freeapi.robtex.com/ipquery/2600:9000:223d:7c00:b:621d:79c0:93a1": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
20:49:01.510850 Robtex: ip_info request to service failed: Get "https://freeapi.robtex.com/ipquery/2600:9000:223d:7c00:b:621d:79c0:93a1": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
21:16:46.240303 AlienVault: https://otx.alienvault.com/api/v1/indicators/domain/yahoo.com/url_list?page=2080: Get "https://otx.alienvault.com/api/v1/indicators/domain/yahoo.com/url_list?page=2080": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
...

bountyflow avatar Jul 20 '22 08:07 bountyflow

Any update?

AeshEmi1 avatar Jan 04 '23 06:01 AeshEmi1

At a glance, seems like this area of the code isn't being utilized properly else where or working as expected? 🤔 @caffix https://github.com/OWASP/Amass/blob/master/config/datasrcs.go#L90

I didn't read the rest of the code base so I dunno, just wonderin'. Cheers 🍻

mr-pmillz avatar Mar 24 '23 23:03 mr-pmillz