scorecard icon indicating copy to clipboard operation
scorecard copied to clipboard

:sparkles: Add important Go packages to projects.csv

Open aklevans opened this issue 1 year ago • 9 comments

@seelder

What kind of change does this PR introduce?

This change adds 37614 Go packages that we considered to be significant. This was determined by including packages that have any dependents with a different owner/organization.

What is the current behavior?

There are currently ~1,280,000 packages in projects.csv that are scanned weekly.

What is the new behavior (if this is a feature change)?**

An additional 37,614 packages will be included in the weekly scan.

  • [ ] Tests for the changes have been added (for bug fixes/features)

No tests were added as code was not changed.

Which issue(s) this PR fixes

NONE

Special notes for your reviewer

7,442 of the added packages already have scorecard data in the BigQuery dataset. I'm unsure if these used to be in projects.csv and were removed at some point or if their scores were gathered from another source. If you want me to remove them, this can be done.

Does this PR introduce a user-facing change?

NONE

aklevans avatar Jun 14 '24 15:06 aklevans

As a followup, I discovered that all of the 7442 packages that have scorecard data in BigQuery but were no longer in projects.csv were removed in #1182. These packages seem to be used significantly enough to be included in the dataset but if there was a specific reason they were removed then I can take them back out.

aklevans avatar Jun 14 '24 18:06 aklevans

As a followup, I discovered that all of the 7442 packages that have scorecard data in BigQuery but were no longer in projects.csv were removed in #1182. These packages seem to be used significantly enough to be included in the dataset but if there was a specific reason they were removed then I can take them back out.

I checked with Azeem offline and it seems like the URLs which were removed were possibly duplicates, redirects (if the repo was renamed), or 404s. Do you have an example of some removed repos? GitHub's UI for these large diffs can be hard to work with.

spencerschrock avatar Jun 17 '24 20:06 spencerschrock

As a followup, I discovered that all of the 7442 packages that have scorecard data in BigQuery but were no longer in projects.csv were removed in #1182. These packages seem to be used significantly enough to be included in the dataset but if there was a specific reason they were removed then I can take them back out.

I checked with Azeem offline and it seems like the URLs which were removed were possibly duplicates, redirects (if the repo was renamed), or 404s. Do you have an example of some removed repos? GitHub's UI for these large diffs can be hard to work with.

@aklevans managed to get this out right before he was out of office for a bit. I'm taking a look while he's gone.

seelder avatar Jun 18 '24 20:06 seelder

Sorry, hit "enter" before finishing that - the dates line up that it could have been #1182, and some of the ones I'm seeing ARE forks. However, I need to go back and look at the previous date to confirm.

Glancing through are a couple of these I'm not sure about. One example is: github.com/azure/azure-storage-queue-go. It is possible there's a fork of that somewhere, but it is NOT explicitly listed as a fork

Another example is github.com/sectorbob/mlab-ns2, where technically it is a fork - but the original project isn't picked up by scorecard. github.com/sectorbob/mlab-ns2 has Dependents, while the original project doesn't, so that might be part of it.

EDIT: A third example is github.com/algorithmiaio/mapstructure, which would possibly be explained as a "duplicate", if I assume forks are duplicates. I'll have to look at the other two more closely, though, because they don't seem to be duplicates of existing data.

Do those examples help?

seelder avatar Jun 18 '24 20:06 seelder

which would possibly be explained as a "duplicate", if I assume forks are duplicates

I believe duplicate at the time was a true duplicate, not a fork.

e.g.

github.com/foo/bar and github.com/Foo/bar

spencerschrock avatar Jun 18 '24 22:06 spencerschrock

Is there a way I can make the change to the PR or would it make more sense for me to start a new PR? I can always remove the 7442

seelder avatar Jun 19 '24 02:06 seelder

Out of that 7442 list from 31fd69a31b61d7cf1e872943897c4841297fc3d3, there were only a few projects that 404, which was my primary concern.

client9/reopen gamexg/godaemon gamexg/memstream mrhea/distributed-key-value-store pivotal-cf/paraphernalia verticalpalette/ae

There were quite a few projects that have been renamed/transferred though. Renaming projects is a tricky spot for the cron. so I'd like to get it put in under the "new" name. but not sure how that complicates your analysis

Renamed repos
11c11
< 10gen-labs/slogger
---
> mongodb-labs/slogger
13,14c13,14
< 1354092549/wsrpc
< 18f/cg-dashboard
---
> arcticlampyrid/wsrpc
> cloud-gov/cg-dashboard
89,91c89,91
< activestate/httpapi
< activestate/run
< activestate/tail
---
> hpcloud/httpapi
> hpcloud/run
> hpcloud/tail
147,148c147,148
< aelsabbahy/go-ps
< aelsabbahy/gonetstat
---
> goss-org/go-ps
> goss-org/gonetstat
179,180c179,180
< ahmetalpbalkan/dexec
< ahmetalpbalkan/go-linq
---
> ahmetb/go-dexec
> ahmetb/go-linq
183,184c183,184
< airking05/termui
< airware/vili
---
> purplesmoke05/termui
> viliproject/vili
187c187
< akagi201/utilgo
---
> akagi201/utils-go
206c206
< akyoto/imageoutput
---
> akyoto/imageserver
221c221
< albrow/go-data-parser
---
> albrow/forms
250c250
< alexellis/faas
---
> openfaas/faas
257c257
< alexpanxx/fsnotify
---
> alexpan0610/fsnotify
281c281
< alioygur/godash
---
> aliuygur/godash
314c314
< anachronistic/apns
---
> coccodrillo/apns
376c376
< apex/go-apex
---
> apex/apex-go
406c406
< arafatk/glot
---
> arafatkatze/glot
411c411
< arcaneiceman/govector
---
> distributedclocks/govector
426c426
< armpelionedge/wpa-connect
---
> pelioniot/wpa-connect
433c433
< arstd/log
---
> omigo/log
486,487c486,487
< asynkronit/gonet
< asynkronit/goring
---
> asynkron/gonet
> asynkron/goring
520c520
< ayufan/golang-kardianos-service
---
> ayufan-research/golang-kardianos-service
536c536
< b4b4r07/go-cli-log
---
> babarot/go-cli-log
583c583
< bclicn/color
---
> sudo-bcli/color
587c587
< bearchinc/datastore-model
---
> getambush/datastore-model
634c634
< beyond-simplechain/foundation
---
> beyondev/foundation
644,645c644,645
< biezhi/gorm-paginator
< bigdatadev/goryman
---
> hellokaton/gorm-paginator
> cjgdev/goryman
674c674
< blackespresso/htmlcheck
---
> mpfund/htmlcheck
682c682
< blagojts/viper
---
> atanasovskib/viper
695,696c695,696
< blitzprog/color
< blk-io/chimera-api
---
> akyoto/color
> web3labs/chimera-api
742c742
< bosh-prometheus/firehose_exporter
---
> cloudfoundry/firehose_exporter
773c773
< brankas/sentinel
---
> kenshaw/sentinel
824c824
< bugagazavr/go-gitlab-client
---
> kzaitsev/go-gitlab-client
830c830
< buildpack/libbuildpack
---
> buildpacks/libbuildpack
881c881
< c3systems/c3-go
---
> opennetsys/c3-go
888c888
< caarlos0/spin
---
> caarlos0-graveyard/spin
923c923
< carlmjohnson/flagext
---
> earthboundkid/flagext
927c927
< carted/graphql
---
> evulse/graphql
941,942c941,942
< cavaliercoder/go-cpio
< cavaliercoder/go-rpm
---
> cavaliergopher/cpio
> cavaliergopher/rpm
953c953
< celrenheit/sandglass
---
> sandglass/sandglass
956c956
< centimitr/namespace
---
> centimitr/simple-namespace
970c970
< cfmobile/gmock
---
> vmware-archive/gmock
986c986
< chaos-mesh/matrix
---
> pingcap-qe/matrix
991c991
< chaseadamsio/goorgeous
---
> curiouslychase/goorgeous
993c993
< chasex/redis-go-cluster
---
> wuxibin89/redis-go-cluster
1002,1003c1002,1003
< chewxy/vecf32
< chewxy/vecf64
---
> gorgonia/vecf32
> gorgonia/vecf64
1017,1024c1017,1024
< choria-io/go-client
< choria-io/go-config
< choria-io/go-confkey
< choria-io/go-lifecycle
< choria-io/go-protocol
< choria-io/go-puppet
< choria-io/go-security
< choria-io/go-srvcache
---
> choria-legacy/go-client
> choria-legacy/go-config
> choria-legacy/go-confkey
> choria-legacy/go-lifecycle
> choria-legacy/go-protocol
> choria-legacy/go-puppet
> choria-legacy/go-security
> choria-legacy/go-srvcache
1026,1027c1026,1027
< choria-io/go-validator
< choria-io/mcorpc-agent-provider
---
> choria-legacy/go-validator
> choria-legacy/mcorpc-agent-provider
1060c1060
< clever/gearman-go
---
> graveyard/gearman-go
1074c1074
< cloudflare/sidh
---
> cloudflarearchive/sidh
1077c1077
< cloudfoundry-community/s3-broker
---
> cloud-gov/s3-broker
1079,1080c1079,1080
< cloudfoundry-incubator/candiedyaml
< cloudfoundry-incubator/cf-test-helpers
---
> cloudfoundry-attic/candiedyaml
> cloudfoundry/cf-test-helpers
1084,1085c1084,1085
< cloudfoundry/bosh-init
< cloudfoundry/custom-cats-reporters
---
> cloudfoundry-attic/bosh-init
> cloudfoundry/honeycomb-ginkgo-reporter
1089c1089
< cloudfoundry/jibber_jabber
---
> cloudfoundry-attic/jibber_jabber
1091c1091
< cloudfoundry/loggregatorlib
---
> cloudfoundry-attic/loggregatorlib
1094c1094
< cloudvm/gortp
---
> evie/gortp
1099c1099
< cmckee-dev/go-alpha-vantage
---
> curtismckee/go-alpha-vantage
1133c1133
< code-ready/goodhosts
---
> crc-org/goodhosts
1136,1142c1136,1142
< codedellemc/dvdcli
< codedellemc/goioc
< codedellemc/goisilon
< codedellemc/gorackhd-redfish
< codedellemc/gournal
< codedellemc/libstorage
< codedellemc/rexray
---
> rexray/dvdcli
> akutz/goioc
> thecodeteam/goisilon
> thecodeteam/gorackhd-redfish
> akutz/gournal
> thecodeteam/libstorage
> rexray/rexray
1146,1147c1146,1147
< codegangsta/martini
< codegangsta/negroni
---
> go-martini/martini
> urfave/negroni
1178c1178
< concourse/atc
---
> vmware-archive/atc
1181,1182c1181,1182
< concourse/go-archive
< concourse/go-concourse
---
> vmware-archive/go-archive
> vmware-archive/go-concourse
1187c1187
< conformal/winsvc
---
> btcsuite/winsvc
1190c1190
< contactless/org.eclipse.paho.mqtt.golang
---
> wirenboard/org.eclipse.paho.mqtt.golang
1201c1201
< contribute-torque/gui-miner
---
> scala-network/gui-miner
1256c1256
< cozely/cozely
---
> drakmaniso/old-cozely
1314,1315c1314,1315
< cupcake/rdb
< cupcake/sigil
---
> tent/rdb
> tent/sigil
1325c1325
< cybozu-go/cmd
---
> cybozu-go/well
1362c1362
< daneharrigan/hipchat
---
> dane/hipchat
1384c1384
< dataence/encoding
---
> zentures/encoding
1387c1387
< datatogether/sqlutil
---
> datatogether/sql_util
1418,1419c1418,1419
< dc0d/inflect
< dc0d/retry
---
> workshop-depot/inflect
> workshop-depot/retry
1457c1457
< debtstracker/translations
---
> sneat-co/debtstracker-translations
1471c1471
< deislabs/smi-sdk-go
---
> servicemeshinterface/smi-sdk-go
1475c1475
< denis-tingajkin/go-header
---
> denis-tingaikin/go-header
1478,1479c1478,1479
< deniswernert/go-fstab
< deniswernert/udev
---
> d-tux/go-fstab
> d-tux/udev
1497,1498c1497,1498
< devopsfaith/flatmap
< deweppro/go-algorithms
---
> krakend/flatmap
> osspkg/go-algorithms
1531c1531
< di-wu/xsd-datetime
---
> q-uint/xsd-datetime
1535c1535
< dickeyxxx/golock
---
> jdx/golock
1561c1561
< discoviking/fsm
---
> rynorris/fsm
1565c1565
< disiqueira/gotree
---
> d6o/gotree
1583c1583
< dmotylev/nutrition
---
> dmotylev/appconfig
1594c1594
< docker/go-p9p
---
> docker-archive/go-p9p
1596,1597c1596,1597
< docker/leadership
< docker/libcontainer
---
> docker-archive/leadership
> docker-archive/libcontainer
1599c1599
< docker/spdystream
---
> moby/spdystream
1601c1601
< docopt/docopt-go
---
> docopt/docopt.go
1619c1619
< doxxan/appindicator
---
> perlw/appindicator
1623c1623
< dpordomingo/go-gingonic-cache
---
> gin-contrib/cache
1744,1745c1744,1745
< eawsy/aws-lambda-go-core
< eawsy/aws-lambda-go-event
---
> lifadev/archive_aws-lambda-go-core
> lifadev/archive_aws-lambda-go-event
1759c1759
< eclipse/che-go-jsonrpc
---
> eclipse-che/che-go-jsonrpc
1801c1801
< egymgmbh/go-prefix-writer
---
> egym-playground/go-prefix-writer
1842c1842
< elrondnetwork/concurrent-map
---
> multiversx/concurrent-map
1847,1850c1847,1850
< emc-advanced-dev/pkg
< emccode/goisilon
< emccode/gorackhd
< emccode/gorackhd-redfish
---
> solo-io/pkg
> thecodeteam/goisilon
> thecodeteam/gorackhd
> thecodeteam/gorackhd-redfish
1869c1869
< endfirstcorp/peekingreader
---
> robarchibald/peekingreader
1883c1883
< ericlagerg/compressedhandler
---
> ericlagergren/compressedhandler
1897,1898c1897,1898
< erroneousboat/termui
< esailors/go-datadog
---
> jpbruinsslot/termui
> lotto24/go-datadog
1924c1924
< everdev/mack
---
> andybrewer/mack
1961c1961
< fabse333/goml
---
> uncatchable-de/goml
1963,1988c1963,1988
< facebookgo/atomicfile
< facebookgo/clock
< facebookgo/errgroup
< facebookgo/flag.addrs
< facebookgo/flagenv
< facebookgo/freeport
< facebookgo/ganglia
< facebookgo/grace
< facebookgo/httpcontrol
< facebookgo/httpdown
< facebookgo/inject
< facebookgo/limitgroup
< facebookgo/metrics
< facebookgo/muster
< facebookgo/pidfile
< facebookgo/pqueue
< facebookgo/rpool
< facebookgo/runcmd
< facebookgo/stack
< facebookgo/stackerr
< facebookgo/stats
< facebookgo/structtag
< facebookgo/subset
< facebookgo/testname
< facebookgo/waitout
< facebookincubator/flog
---
> facebookarchive/atomicfile
> facebookarchive/clock
> facebookarchive/errgroup
> facebookarchive/flag.addrs
> facebookarchive/flagenv
> facebookarchive/freeport
> facebookarchive/ganglia
> facebookarchive/grace
> facebookarchive/httpcontrol
> facebookarchive/httpdown
> facebookarchive/inject
> facebookarchive/limitgroup
> facebookarchive/metrics
> facebookarchive/muster
> facebookarchive/pidfile
> facebookarchive/pqueue
> facebookarchive/rpool
> facebookarchive/runcmd
> facebookarchive/stack
> facebookarchive/stackerr
> facebookarchive/stats
> facebookarchive/structtag
> facebookarchive/subset
> facebookarchive/testname
> facebookarchive/waitout
> facebookarchive/flog
2041c2041
< ferluci/fast-realip
---
> ferluci/fasthttp-realip
2053c2053
< fiatjaf/bip340
---
> nbd-wtf/bip340
2084,2090c2084,2090
< flynn/discoverd
< flynn/flynn-host
< flynn/go-discoverd
< flynn/go-dockerclient
< flynn/go-flynn
< flynn/go-shlex
< flynn/go-sql
---
> flynn-archive/discoverd
> flynn-archive/flynn-host
> flynn-archive/go-discoverd
> flynn-archive/go-dockerclient
> flynn-archive/go-flynn
> flynn-archive/go-shlex
> flynn-archive/go-sql
2092c2092
< flynn/json5
---
> titanous/json5
2094,2096c2094,2096
< flynn/pq
< flynn/rpcplus
< flynn/strowger
---
> flynn-archive/pq
> flynn-archive/rpcplus
> flynn-archive/strowger
2099c2099
< fogcreek/slack
---
> glitchdotcom/slack
2136,2140c2136,2140
< frankrap/bitmex-api
< frankrap/bybit-api
< frankrap/deribit-api
< frankrap/huobi-api
< frankrap/okex-api
---
> f0cii/bitmex-api
> f0cii/bybit-api
> f0cii/deribit-api
> f0cii/huobi-api
> f0cii/okex-api
2159c2159
< fsm/target-util
---
> brandonromano/target-util
2186c2186
< fuserobotics/gogame
---
> paralin/gogame
2188c2188
< fuzxxl/nfc
---
> clausecker/nfc
2190c2190
< fw42/go-hpfeeds
---
> hpfeeds/go-hpfeeds
2212c2212
< gardener/gardener-extensions
---
> gardener-attic/gardener-extensions
2225,2226c2225,2226
< gbevan/goswim
< gbraad/go-hvkvp
---
> gbevan/gostint
> gbraad-fedora/go-hvkvp
2243c2243
< gdexlab/go-render
---
> gdex-lab/go-render
2249,2250c2249,2250
< geek1011/czlib
< geek1011/repogen
---
> pgaskin/czlib
> pgaskin/repogen
2263c2263
< generaltso/sadbox
---
> dayvonjersen/sadbox
2310c2310
< getwe/figlet4go
---
> weberhong/figlet4go
2347c2347
< ginuerzh/gosocks4
---
> go-gost/gosocks4
2349c2349
< ginuerzh/tls-dissector
---
> go-gost/tls-dissector
2389c2389
< glynternet/gohmoney
---
> glynternet/go-money
2411c2411
< go-chassis/go-cc-client
---
> go-chassis/go-chassis-config
2419c2419
< go-contrib/uuid
---
> satori/go.uuid
2427c2427
< go-develop/coinrpc
---
> coinsgo/coinrpc
2436c2436
< go-forensics/binarytransforms
---
> alecrandazzo/binarytransforms
2450c2450
< go-gl/glu
---
> go-gl-legacy/glu
2489c2489
< go-mangos/mangos
---
> nanomsg/mangos-v1
2628,2629c2628,2629
< goextension/io
< goextension/log
---
> go-exts/io
> go-exts/log
2639c2639
< gofortune/gofortune
---
> vromero/gofortune
2658c2658
< gogits/go-gogs-client
---
> gogs/go-gogs-client
2687c2687
< gojektech/valkyrie
---
> gojek/valkyrie
2703c2703
< golang-source-engine/stringtable
---
> galaco/stringtable
2759c2759
< goods/httpbuf
---
> go-goods/httpbuf
2772c2772
< gopistolet/gopistolet
---
> mistralmail/mistralmail
2792c2792
< gosidekick/migration
---
> crgimenes/migration
2812c2812
< goware/cors
---
> go-chi/cors
2814c2814
< goware/httpcoala
---
> go-chi/httpcoala
2838c2838
< graphism/dot
---
> mewspring/dot
2856c2856
< gropensourcedev/go-ntlm-auth
---
> g-research/go-ntlm-auth
2883c2883
< gxba/binary
---
> gxlb/binary
2952,2956c2952,2956
< hatch1fy/cron
< hatch1fy/errors
< hatch1fy/filecacher
< hatch1fy/fileserver
< hatch1fy/poller
---
> hatchify/cron
> hatchify/errors
> gdbu/filecacher
> gdbu/fileserver
> gdbu/poller
2962,2963c2962,2963
< hatchify/filecacher
< hatchify/fileserver
---
> gdbu/filecacher
> gdbu/fileserver
2967,2970c2967,2970
< hatchify/poller
< hatchify/queue
< hatchify/scribe
< havoc-io/gopass
---
> gdbu/poller
> gdbu/queue
> gdbu/scribe
> mutagen-io/gopass
2973c2973
< hayswim/data
---
> deleteriouseffect/data
2996,3001c2996,3001
< henrydcase/nobs
< henrylee2cn/cfgo
< henrylee2cn/mahonia
< henrylee2cn/pholcus_lib
< henrylee2cn/structtag
< henrylee2cn/tp-ext
---
> kriskwiatkowski/nobs
> andeya/cfgo
> andeya/mahonia
> andeya/pholcus_lib
> andeya/structtag
> andeya/tp-ext
3005c3005
< heptiolabs/healthcheck
---
> vmware-archive/healthcheck
3041c3041
< hippoai/goerr
---
> selimyoussry/goerr
3057c3057
< hnlq715/gobreak
---
> sysulq/gobreak
3118c3118
< husl-colors/husl-go
---
> hsluv/hsluv-go
3175,3176c3175,3176
< imdario/go-ulid
< imdario/medeina
---
> darccio/go-ulid
> darccio/medeina
3196c3196
< infinitbyte/framework
---
> infinilabs/framework
3239,3242c3239,3242
< integration-system/bellows
< integration-system/go-cmp
< integration-system/gowsdl
< integration-system/jsonschema
---
> txix-open/bellows
> txix-open/go-cmp
> txix-open/gowsdl
> txix-open/jsonschema
3256,3257c3256,3257
< iotbzh/xds-common
< iotbzh/xds-server
---
> iotbzh/deprecated_xds-common
> iotbzh/deprecated_xds-server
3260c3260
< ipfs/go-ipfs-addr
---
> ipfs-inactive/go-ipfs-addr
3262,3265c3262,3265
< ipfs/go-ipfs-flags
< ipfs/go-libp2p-crypto
< ipfs/go-libp2p-peer
< ipfs/go-libp2p-secio
---
> ipfs-inactive/go-ipfs-flags
> libp2p/go-libp2p-crypto
> libp2p/go-libp2p-peer
> libp2p/go-libp2p-secio
3297c3297
< it-chain/leveldb-wrapper
---
> de-labtory/leveldb-wrapper
3365c3365
< jakehl/goid
---
> jakenvac/goid
3401c3401
< jbenet/go-stream-muxer
---
> libp2p/go-stream-muxer
3420c3420
< jdxcode/netrc
---
> jdx/go-netrc
3451c3451
< jfrazelle/go
---
> docker/go
3484c3484
< jingweno/go-sawyer
---
> owenthereal/go-sawyer
3511c3511
< jobbitz/strct
---
> jobstoit/strct
3532c3532
< jonas747/gojay
---
> botlabs-gg/gojay
3553,3554c3553,3554
< joshlf13/erreq
< joshlf13/term
---
> joshlf/erreq
> joshlf/term
3556,3560c3556,3560
< joushou/g9p
< joushou/qp
< joushou/qptools
< joushou/serve2
< joyent/triton-go
---
> kennylevinsen/g9p
> kennylevinsen/qp
> kennylevinsen/qptools
> kennylevinsen/serve2
> tritondatacenter/triton-go
3577,3578c3577,3578
< jqatampa/gadget-arm
< jragonmiris/mathgl
---
> tampajohn/gadget-arm
> userab1236872/mathgl
3593,3595c3593,3595
< jtolds/gls
< jtolds/monkit-hw
< jtolds/tracetagger
---
> jtolio/gls
> jtolio/monkit-hw
> jtolio/tracetagger
3600c3600
< juju/deputy
---
> natefinch/deputy
3637,3639c3637,3639
< julienroland/usg
< julzdiverse/goml
< julzdiverse/mingoak
---
> juxr/usg
> herrjulz/goml
> herrjulz/mingoak
3642c3642
< junhsieh/iojson
---
> junxie6/iojson
3670,3671c3670,3671
< k14s/difflib
< k14s/kwt
---
> carvel-dev/difflib
> carvel-dev/kwt
3682c3682
< kami-zh/go-capturer
---
> zenizh/go-capturer
3703c3703
< kashomon/goglicko
---
> artasparks/goglicko
3713c3713
< katsuomi/liketwitterapp-backend
---
> katsuomi/tsubuyakitter-backend
3718,3719c3718,3719
< kballard/gocallback
< kch42/buzhash
---
> lilyball/gocallback
> silvasur/buzhash
3764c3764
< keybase/go.dbus
---
> keybase/dbus
3797c3797
< kless/term
---
> tredoe/term
3866c3866
< kris-nova/lolgopher
---
> krisnova/lolgopher
3873c3873
< kshvmdn/point
---
> kashav/point
3885c3885
< kubeapps/common
---
> vmware-archive/common
3887c3887
< kubernetes-incubator/external-storage
---
> kubernetes-retired/external-storage
3937,3938c3937,3938
< landoop/schema-registry
< landoop/tableprinter
---
> lensesio/schema-registry
> lensesio/tableprinter
3946c3946
< laughs-in-flowers/xrr
---
> 1xch/xrr
3957c3957
< lazywei/go-opencv
---
> go-opencv/go-opencv
4008,4009c4008,4009
< lestrrat/go-jsref
< lestrrat/go-jsschema
---
> lestrrat-go/jsref
> lestrrat-go/jsschema
4036c4036
< liamhaworth/go-tproxy
---
> katelynhaworth/go-tproxy
4078c4078
< likexian/doh-go
---
> likexian/doh
4094c4094
< lindgrenj6/sources-api-client-go
---
> redhatinsights/sources-api-client-go
4109c4109
< lithdew/kademlia
---
> lithdew/kademlia-go
4146c4146
< logv/loglogbeta
---
> logv-aux/loglogbeta
4161c4161
< lox/bintest
---
> buildkite/bintest
4179c4179
< luismesas/go-rpi
---
> luismesas/gopi
4218c4218
< m3db/client_golang
---
> m3db/prometheus_client_golang
4251c4251
< mailgun/predicate
---
> vulcand/predicate
4261c4261
< mame82/p4wnp1_go
---
> rogandawes/p4wnp1_aloa
4275c4275
< maoxs2/go-aead-iostream
---
> c0mm4nd/go-aead-iostream
4280c4280
< marcmak/calc
---
> marcak/calc
4311c4311
< marten-seemann/qpack
---
> quic-go/qpack
4406c4406
< maxwellhealth/go-dotaccess
---
> go-bongo/go-dotaccess
4449c4449
< mediabuyerbot/go-crx3
---
> mmadfox/go-crx3
4458c4458
< mellanox/rdma-cni
---
> k8snetworkplumbingwg/rdma-cni
4460c4460
< melnikk/oauth2_proxy
---
> skbkontur/oauth2_proxy
4477c4477
< mesosphere/tweeter-go
---
> mesosphere-backup/tweeter-go
4510,4512c4510,4512
< micro-plat/gmq
< micro/dev
< microapis/messages-core
---
> lib4dev/gmq
> micro/website
> blue-factory/messages-core
4535c4535
< miku/islint
---
> miku/istools
4593,4598c4593,4598
< mjibson/esc
< mjibson/gme
< mjibson/gmusic
< mjibson/go-dsp
< mjibson/gpsoauth
< mjibson/nsf
---
> maddyblue/esc
> maddyblue/gme
> maddyblue/gmusic
> maddyblue/go-dsp
> maddyblue/gpsoauth
> maddyblue/nsf
4628,4629c4628,4629
< modcloth/go-fileutils
< modcloth/kamino
---
> rafecolton/go-fileutils
> rafecolton/kamino
4633c4633
< modocache/gover
---
> sozorogami/gover
4715c4715
< mritd/gcrsync
---
> mritd/imgsync
4727c4727
< msbranco/goconfig
---
> miguelbranco80/goconfig
4752,4753c4752,4753
< multiplay/go-slack
< multiplay/go-ts3
---
> unity-technologies/go-slack
> unity-technologies/go-ts3
4765c4765
< mvader/useragent
---
> erizocosmico/useragent
4767c4767
< mwielbut/pointy
---
> openly-engineering/pointy
4781c4781
< mzz2017/shadowsocksr
---
> v2raya/shadowsocksr
4803c4803
< narmitech/cloudwatchmetricbeat
---
> narmi/cloudwatchmetricbeat
4821c4821
< nazwa/profiler
---
> nazwa-forks/profiler
4873c4873
< netfoundry/secretstream
---
> openziti/secretstream
4903c4903
< niemeyer/qml
---
> go-qml/qml
4945c4945
< noahorberg/nimvle.nvim
---
> n04ln/nimvle.nvim
4949c4949
< nogoegst/wslpath
---
> unkaktus/wslpath
4985c4985
< nullrocks/identicon
---
> rrivera/identicon
5021c5021
< ockam-network/did
---
> build-trust/did
5059c5059
< omeid/livereload
---
> omeid/go-livereload
5081c5081
< open-falcon/common
---
> open-falcon-archive/common
5091c5091
< openlyinc/pointy
---
> openly-engineering/pointy
5107c5107
< openzipkin/zipkin-go-opentracing
---
> openzipkin-contrib/zipkin-go-opentracing
5114,5115c5114,5115
< opesun/goquery
< opesun/trigga
---
> crufter/goquery
> crufter/trigga
5118,5119c5118,5119
< oragono/confusables
< oragono/go-ident
---
> ergochat/confusables
> ergochat/go-ident
5127,5128c5127,5128
< orivil/xcfg
< ory-am/common
---
> xxengine/xcfg
> ory/common
5143c5143
< otium/ytdl
---
> rylio/ytdl
5165c5165
< pagerduty/godspeed
---
> theckman/godspeed
5186c5186
< path94/atoms
---
> pathdna/atoms
5191c5191
< patrickalin/gorest
---
> patrickalin/http-go
5197c5197
< paulrosania/go-charset
---
> tessro/go-charset
5201c5201
< pavel-v-chernykh/keystore-go
---
> pavlo-v-chernykh/keystore-go
5230c5230
< penlook/redis
---
> penlooktmp/redis
5267c5267
< pickme-go/traceable-context
---
> pickme-lk/traceable-context
5275,5276c5275,5276
< pilosa/go-pilosa
< pilu/config
---
> featurebasedb/go-pilosa
> gravityblast/config
5285c5285
< pions/pkg
---
> pion/pkg
5293,5294c5293,5294
< pivotal-cf-experimental/jibber_jabber
< pivotal-cf-experimental/service-config
---
> cloudfoundry-attic/jibber_jabber
> vmware-archive/service-config
5296,5298c5296,5298
< pivotal-cf/graphite-nozzle
< pivotal-cf/jhanda
< pivotal-cf/pg2mysql
---
> vmware-archive/graphite-nozzle
> vmware-archive/jhanda
> vmware-archive/pg2mysql
5301,5304c5301,5304
< pivotal/go-ape
< pivotal/go-smtpd
< pivotal/image-relocation
< pivotalservices/goblob
---
> vmware-archive/go-ape
> vmware-archive/go-smtpd
> vmware-archive/image-relocation
> vmware-archive/goblob
5331,5333c5331,5333
< pmylund/go-bitset
< pmylund/go-cache
< pmylund/sortutil
---
> patrickmn/go-bitset
> patrickmn/go-cache
> patrickmn/sortutil
5340c5340
< polaris-team/converter
---
> star-table/converter
5362,5363c5362,5363
< preetam/catena
< preetam/cistern
---
> cistern/catena
> cistern/cistern
5366,5370c5366,5370
< preetam/proto
< preetam/sflow
< preetam/snmp
< preetamjinka/catena
< preetamjinka/orderedlist
---
> cistern/proto
> cistern/sflow
> cistern/snmp
> cistern/catena
> preetam/orderedlist
5417,5420c5417,5420
< pucklamotzer09/glslgenerator
< puerkitobio/ghost
< puerkitobio/gocoro
< puerkitobio/gred
---
> pucklaj/glslgenerator
> mna/ghost
> mna/gocoro
> mna/gred
5429,5432c5429,5432
< pursuit92/openstack-core
< pursuit92/openstack-identity
< pursuit92/openstack-image
< pursuit92/openstack-network
---
> jrobsonchase/openstack-core
> jrobsonchase/openstack-identity
> jrobsonchase/openstack-image
> jrobsonchase/openstack-network
5586c5586
< rancherio/go-rancher
---
> rancher/go-rancher
5594c5594
< ravernkoh/cwlogsfmt
---
> ravern/cwlogsfmt
5683c5683
< rickypai/natsort
---
> evie404/natsort
5691c5691
< rivalo/discordgo_cli
---
> rickvanloo/discordgo_cli
5705c5705
< rneugeba/iso9660wrap
---
> rn/iso9660wrap
5740,5741c5740,5741
< rompei/exmat
< rompei/mat
---
> lon9/exmat
> lon9/mat
5760c5760
< ru-lai/go-rint
---
> nnashwin/go-rint
5800c5800
< safeie/goconfig
---
> hengfeiyang/goconfig
5818c5818
< santiaago/gonawin
---
> taironas/gonawin
5829c5829
< satori/uuid
---
> satori/go.uuid
5857c5857
< schollz/mapslimmer
---
> schollz/stringsizer
5910,5912c5910,5912
< segmentio/go-dup
< segmentio/go-env
< segmentio/go-log
---
> segment-boneyard/go-dup
> segment-boneyard/go-env
> segment-boneyard/go-log
5917c5917
< segmentio/taskstats
---
> segment-boneyard/taskstats
5948c5948
< shafreeck/fperf
---
> fperf/fperf
6005c6005
< shurcool/gopherjslib
---
> shurcool-deprecated/gopherjslib
6012c6012
< shurcool/octiconssvg
---
> shurcool/octicon
6015c6015
< shxsun/monitor
---
> codeskyblue/monitor
6017,6018c6017,6018
< sico-ops/dao
< sico-ops/pb
---
> sico-sys/dao
> sico-sys/pb
6021c6021
< siddontang/go-mysql-elasticsearch
---
> go-mysql-org/go-mysql-elasticsearch
6036,6038c6036,6038
< signalfx/metricproxy
< sigu-399/gojsonpointer
< sigu-399/gojsonreference
---
> signalfx/gateway
> xeipuuv/gojsonpointer
> xeipuuv/gojsonreference
6089c6089
< smagic39/goth
---
> phamngsinh/goth
6095c6095
< smart-evolution/smarthome
---
> smart-evolution/shapi
6098,6102c6098,6102
< smartystreets-prototypes/go-disruptor
< smartystreets/clock
< smartystreets/go-aws-auth
< smartystreets/logging
< smartystreets/mafsa
---
> smarty-prototypes/go-disruptor
> smarty-archives/clock
> smarty-archives/go-aws-auth
> smarty-archives/logging
> smarty-archives/mafsa
6152c6152
< soopsio/go-utils
---
> nxsre/go-utils
6188c6188
< spiegel-im-spiegel/go-cvss
---
> goark/go-cvss
6235c6235
< starkandwayne/goutils
---
> qarik-group/goutils
6244,6245c6244,6245
< steakknife/bloomfilter
< steakknife/hamming
---
> skull-squadron/bloomfilter
> skull-squadron/hamming
6261c6261
< str1ngs/ansi
---
> mrosset/ansi
6271c6271
< stretchr/graceful
---
> tylerstillwater/graceful
6276c6276
< stripe/go-einhorn
---
> stripe-archive/go-einhorn
6278,6279c6278,6279
< strongo/app
< strongo/bots-api-fbm
---
> strongo/strongoapp
> bots-go-framework/bots-api-fbm
6307,6309c6307,6309
< surge/porter2
< surgebase/glog
< surgemq/message
---
> zentures/porter2
> surge/glog
> zentures/message
6319c6319
< swgloomy/gutil
---
> serendipity-sw/gutil
6393c6393
< techleeone/gophp
---
> leeqvip/gophp
6396c6396
< techoner/gophp
---
> leeqvip/gophp
6403,6404c6403,6404
< tehjojo/go-rtorrent
< tehjojo/go-tvmaze
---
> mrobinsn/go-rtorrent
> mrobinsn/go-tvmaze
6438,6440c6438,6440
< terraform-providers/terraform-provider-aws
< terraform-providers/terraform-provider-openstack
< terraform-providers/terraform-provider-template
---
> hashicorp/terraform-provider-aws
> hashicorp/terraform-provider-openstack
> hashicorp/terraform-provider-template
6483,6484c6483,6484
< thecodeteam/gofsutil
< thecodeteam/goioc
---
> akutz/gofsutil
> akutz/goioc
6491c6491
< theduke/go-apperror
---
> app-kit/go-apperror
6502,6503c6502,6503
< thetannerryan/ring
< thethingsnetwork/go-account-lib
---
> tannerryan/ring
> thethingsarchive/go-account-lib
6505c6505
< thethingsnetwork/go-utils
---
> thethingsarchive/go-utils
6545c6545
< tillberg/ansi-log
---
> tillberg/alog
6604c6604
< tokublock/tokucore
---
> keyfuse/tokucore
6613c6613
< tomsteele/go-nmap
---
> lair-framework/go-nmap
6648c6648
< transceptor-technology/go-qpack
---
> cesbit/go-qpack
6685,6686c6685,6686
< tsuyoshiwada/go-gitcmd
< tsyrul-alexander/xz-data-api
---
> wadackel/go-gitcmd
> tsyrul-oleksandr/xz-data-api
6700,6701c6700,6701
< tuvistavie/securerandom
< tuxychandru/pubsub
---
> danhper/securerandom
> cskr/pubsub
6714c6714
< txsvc/goreq
---
> mickuehl-archive/goreq
6722,6724c6722,6724
< tylerb/codecs
< tylerb/gls
< tylerb/graceful
---
> tylerstillwater/codecs
> tylerstillwater/gls
> tylerstillwater/graceful
6726c6726
< typa01/go-utils
---
> firstsightprettiest/go-utils
6742,6743c6742,6743
< uhoh-itsmaciek/femebe
< ukfast/go-durationstring
---
> msakrejda/femebe
> ans-group/go-durationstring
6788c6788
< unrotten/builder
---
> qktrzrj/builder
6810c6810
< v2pro/wombat
---
> v2pro/plz.codegen
6850,6852c6850,6852
< ventu-io/go-shortid
< verdverm/frisby
< vertcoin/lyra2re
---
> teris-io/shortid
> hofstadter-io/frisby
> vertcoin-project/lyra2re
6854c6854
< verystar/logrus_sentry
---
> goapt/logrus_sentry
6877c6877
< vinceprignano/orchestra
---
> vincepri/orchestra
6879c6879
< viniciuschiele/tarx
---
> viniciuschiele-archive/tarx
6910,6914c6910,6914
< vmware/go-nfs-client
< vmware/goipmi
< vmware/govcloudair
< vmware/photon-controller-go-sdk
< vmware/vmw-ovflib
---
> vmware-archive/go-nfs-client
> vmware-archive/goipmi
> vmware-archive/govcloudair
> vmware-archive/photon-controller-go-sdk
> vmware-archive/vmw-ovflib
6967,6969c6967,6969
< watchbeam/amf0
< watchbeam/fsm
< watchbeam/redutil
---
> microsoft/amf0
> mixer/fsm
> microsoft/redutil
7065c7065
< withmandala/go-log
---
> mandala/go-log
7090c7090
< wule61/log
---
> laredoer/log
7120c7120
< xconstruct/go-pushbullet
---
> cschomburg/go-pushbullet
7130,7131c7130,7131
< xeonx/geom
< xeonx/timeago
---
> simonhege/geom
> simonhege/timeago
7180c7180
< xreception/google-taxonomy-go
---
> idy/google-taxonomy-go
7210,7211c7210,7211
< yahoo/k8s-athenz-syncer
< yaklabs/k8s-client
---
> athenz/k8s-athenz-syncer
> bakins/k8s-client
7242c7242
< yinghau76/adafruit-ble-sniffer-golang
---
> p47t/adafruit-ble-sniffer-golang
7260c7260
< yossefaz/go-http-client
---
> jossefaz/go-http-client
7267c7267
< yottab/proto-api
---
> bitcloud-live/proto-api
7295,7296c7295,7296
< yulibaozi/mapper
< yunify/qsftpd
---
> imyuliz/mapper
> qingstor/qsftpd
7321c7321
< zchee/docker-machine-driver-xhyve
---
> machine-drivers/docker-machine-driver-xhyve
7345c7345
< zfjagann/golang-ring
---
> zealws/golang-ring
7347c7347
< zhangjinpeng1987/raft
---
> zhangjinpeng87/raft
7354,7355c7354,7355
< zhenjl/cityhash
< zhenjl/porter2
---
> zentures/cityhash
> zentures/porter2
7361c7361
< zhouhui8915/engine.io-go
---
> hesh915/engine.io-go
7391,7392c7391,7392
< zondax/hid-go
< zondax/ledger-goclient
---
> zondax/.obsolete-hid-go
> zondax/ledger-cosmos-go
7396,7397c7396,7397
< zpatrick/go-cache
< zpatrick/go-config
---
> ridgelines/go-cache
> ridgelines/go-config
7410c7410
< zzc-tongji/service4mydictionary
---
> mydictionary-project/service4mydictionary
7428c7428
< mixer/clock
---
> microsoft/clock
7432c7432
< taskcluster/ntr
---
> petemoore/ntr

spencerschrock avatar Jun 21 '24 20:06 spencerschrock

I removed all of the renamed urls that redirected to another github repo as well as all urls that returned a 404.

aklevans avatar Jun 25 '24 13:06 aklevans

I removed all of the renamed urls that redirected to another github repo as well as all urls that returned a 404.

Thanks! The cron had issues processing all the repos last week, so I was waiting on this PR until resolved since we need to be able to process the repos we already have.

I believe the underlying issue (https://github.com/google/osv-scanner/issues/1077) was addressed, and I should see adequate progress tomorrow.

spencerschrock avatar Jul 01 '24 22:07 spencerschrock