docs.rs icon indicating copy to clipboard operation
docs.rs copied to clipboard

Published 20 hours ago • verified publisher icon rust-lang

documentation views analytics for crate maintaners

Open petr-tik opened this issue 6 years ago • 6 comments

hey, Thanks for building and maintaining such a great documentation resource. I am one of the contributors to tantivy - a library for building custom search applications.

I was wondering if you collect and would be able to share (privately, if you prefer) analytics for views of specific pages on docs.rs/tantivy.

Since we are building a library, not an application, our main method of helping our users is through examples, good code and documentation.

There are many types, traits and enums in our library and we would like to prioritise our effort to document them (ideally we would like to document all of them, but it's hard).

I think it will be useful to see the top 50 most visited pages on docs.rs/tantivy so we can spend time documenting the most sought-after items.

I appreciate the privacy concerns (entirely valid) and would only request anonymised, aggregated data for only docs.rs/tantivy.

Thanks again for all your great work on this!

petr-tik avatar Nov 14 '19 00:11 petr-tik

Thanks for reaching out! At the moment we don't collect access logs for documentation views, so we're unable to provide you with the data. Anonymized access stats for crate authors would be good to have though, so that's something we could consider in the future.

pietroalbini avatar Nov 14 '19 14:11 pietroalbini

Hey, thanks for your swift reply - appreciate you are busy with normal maintenance.

Glad to hear this is useful and I think many other library developers will appreciate such analytics.

What's the best way for me to start a conversation about this and get more opinions/thoughts/suggestions from other library developers?

I feel that an RFC is too heavy duty for this, so keen to hear your advice on the best format.

I'm curious - does your web server not have any logging of GET requests that we could grep "tantivy" over to get a tough idea?

petr-tik avatar Nov 14 '19 23:11 petr-tik

I'm looking over this now, and it seems we do have some logs in /var/log/nginx we could grep for. Note that these logs are not accurate because we cache using cloudfront, but they might be enough for a rough estimate.

I think @pietroalbini might have meant that we don't track accesses in the application, so this only happens to work in production, and won't be reproducible anywhere else (e.g. if we wanted to show it on the website).

With that said, here are the logs of pages with more than one visit (showing only the URLs without metadata):

logs 
      2 GET /tantivy/%5E0.10
      2 GET /tantivy/%5E0.11.3
      2 GET /tantivy/0.10.0/aliases-20190624-1.37.0-nightly-8aa42ed7c.js
      2 GET /tantivy/0.10.0/search-index-20190624-1.37.0-nightly-8aa42ed7c.js
      2 GET /tantivy/0.10.0/tantivy/merge_policy/struct.NoMergePolicy.html
      2 GET /tantivy/0.10.0/tantivy/schema/struct.NamedFieldDocument.html
      2 GET /tantivy/0.10.0/tantivy/schema/struct.Schema.html
      2 GET /tantivy/0.10.0/tantivy/struct.Document.html
      2 GET /tantivy/0.10.1/search-index-20190720-1.38.0-nightly-95b1fe560.js
      2 GET /tantivy/0.10.1/tantivy/collector/index.html
      2 GET /tantivy/0.10.1/tantivy/postings/index.html
      2 GET /tantivy/0.10.1/tantivy/query/struct.AllScorer.html
      2 GET /tantivy/0.10.1/tantivy/query/struct.FuzzyTermQuery.html
      2 GET /tantivy/0.10.1/tantivy/query/struct.QueryParser.html
      2 GET /tantivy/0.10.1/tantivy/query/trait.Query.html
      2 GET /tantivy/0.10.1/tantivy/schema/index.html
      2 GET /tantivy/0.10.1/tantivy/struct.Document.html
      2 GET /tantivy/0.10.1/tantivy/struct.Index.html
      2 GET /tantivy/0.10.1/tantivy/struct.IndexMeta.html
      2 GET /tantivy/0.10.1/tantivy/struct.IndexReaderBuilder.html
      2 GET /tantivy/0.10.1/tantivy/tokenizer/index.html
      2 GET /tantivy/0.10.2/i686-pc-windows-msvc/tantivy/
      2 GET /tantivy/0.10.2/implementors/tantivy/query/trait.Query.js
      2 GET /tantivy/0.10.2/src/tantivy/fieldnorm/code.rs.html
      2 GET /tantivy/0.10.2/struct.Term.html
      2 GET /tantivy/0.10.2/tantivy/collector/index.html
      2 GET /tantivy/0.10.2/tantivy/collector/sidebar-items.js
      2 GET /tantivy/0.10.2/tantivy/collector/struct.Count.html
      2 GET /tantivy/0.10.2/tantivy/directory/error/enum.LockError.html
      2 GET /tantivy/0.10.2/tantivy/directory/struct.ReadOnlySource.html
      2 GET /tantivy/0.10.2/tantivy/fastfield/sidebar-items.js
      2 GET /tantivy/0.10.2/tantivy/index.html
      2 GET /tantivy/0.10.2/tantivy/query/struct.AllQuery.html
      2 GET /tantivy/0.10.2/tantivy/query/trait.Query.html
      2 GET /tantivy/0.10.2/tantivy/schema/constant.FAST.html
      2 GET /tantivy/0.10.2/tantivy/tokenizer/sidebar-items.js
      2 GET /tantivy/0.10.2/tantivy/type.Opstamp.html
      2 GET /tantivy/0.10.2/x86_64-unknown-linux-gnu/tantivy/
      2 GET /tantivy/0.10.3/implementors/tantivy/query/trait.Query.js
      2 GET /tantivy/0.10.3/src/tantivy/lib.rs.html
      2 GET /tantivy/0.10.3/tantivy/collector/index.html
      2 GET /tantivy/0.10.3/tantivy/enum.ReloadPolicy.html
      2 GET /tantivy/0.10.3/tantivy/enum.SegmentComponent.html
      2 GET /tantivy/0.10.3/tantivy/query/struct.AllScorer.html
      2 GET /tantivy/0.10.3/tantivy/query/struct.EmptyScorer.html
      2 GET /tantivy/0.10.3/tantivy/query/struct.EmptyWeight.html
      2 GET /tantivy/0.10.3/tantivy/query/struct.PhraseQuery.html
      2 GET /tantivy/0.10.3/tantivy/query/struct.TermQuery.html
      2 GET /tantivy/0.10.3/tantivy/query/trait.Query.html
      2 GET /tantivy/0.10.3/tantivy/query/trait.Scorer.html
      2 GET /tantivy/0.10.3/tantivy/schema/struct.Field.html
      2 GET /tantivy/0.10.3/tantivy/struct.DocAddress.html
      2 GET /tantivy/0.10.3/tantivy/struct.IndexReader.html
      2 GET /tantivy/0.10.3/tantivy/struct.IndexReaderBuilder.html
      2 GET /tantivy/0.10.3/tantivy/struct.SegmentMeta.html
      2 GET /tantivy/0.10.3/tantivy/struct.SegmentReader.html
      2 GET /tantivy/0.10.3/tantivy/struct.Term.html
      2 GET /tantivy/0.10.3/tantivy/trait.Directory.html
      2 GET /tantivy/0.10.3/tantivy/trait.DocSet.html
      2 GET /tantivy/0.10.3/tantivy/type.Opstamp.html
      2 GET /tantivy/0.10.3/tantivy/type.Score.html
      2 GET /tantivy/0.10.3/tantivy/type.SegmentLocalId.html
      2 GET /tantivy/0.11.3
      2 GET /tantivy/0.11.3/i686-apple-darwin/tantivy/?search=RegexQuery
      2 GET /tantivy/0.11.3/i686-pc-windows-msvc/tantivy/
      2 GET /tantivy/0.11.3/implementors/tantivy/merge_policy/trait.MergePolicy.js
      2 GET /tantivy/0.11.3/implementors/tantivy/postings/trait.HasLen.js
      2 GET /tantivy/0.11.3/implementors/tantivy/trait.Postings.js
      2 GET /tantivy/0.11.3/src/tantivy/collector/mod.rs.html
      2 GET /tantivy/0.11.3/src/tantivy/common/mod.rs.html
      2 GET /tantivy/0.11.3/src/tantivy/core/index_meta.rs.html
      2 GET /tantivy/0.11.3/src/tantivy/directory/directory.rs.html
      2 GET /tantivy/0.11.3/src/tantivy/indexer/merge_policy.rs.html
      2 GET /tantivy/0.11.3/src/tantivy/lib.rs.html
      2 GET /tantivy/0.11.3/src/tantivy/macros.rs.html
      2 GET /tantivy/0.11.3/src/tantivy/query/query_parser/query_parser.rs.html
      2 GET /tantivy/0.11.3/src/tantivy/query/term_query/term_query.rs.html
      2 GET /tantivy/0.11.3/src/tantivy/schema/schema.rs.html
      2 GET /tantivy/0.11.3/src/tantivy/schema/text_options.rs.html
      2 GET /tantivy/0.11.3/src/tantivy/tokenizer/ascii_folding_filter.rs.html
      2 GET /tantivy/0.11.3/struct.Term.html
      2 GET /tantivy/0.11.3/tantivy/collector/trait.SegmentCollector.html
      2 GET /tantivy/0.11.3/tantivy/directory/
      2 GET /tantivy/0.11.3/tantivy/directory/error/enum.OpenDirectoryError.html
      2 GET /tantivy/0.11.3/tantivy/directory/struct.AntiCallToken.html
      2 GET /tantivy/0.11.3/tantivy/enum.SegmentComponent.html
      2 GET /tantivy/0.11.3/tantivy/enum.TantivyError.html
      2 GET /tantivy/0.11.3/tantivy/fastfield/struct.FastFieldSerializer.html
      2 GET /tantivy/0.11.3/tantivy/fastfield/struct.IntFastFieldWriter.html
      2 GET /tantivy/0.11.3/tantivy/fn.u64_to_f64.html
      2 GET /tantivy/0.11.3/tantivy/merge_policy/sidebar-items.js
      2 GET /tantivy/0.11.3/tantivy/merge_policy/type.DefaultMergePolicy.html
      2 GET /tantivy/0.11.3/tantivy/postings/struct.FieldSerializer.html
      2 GET /tantivy/0.11.3/tantivy/query/fn.intersect_scorers.html
      2 GET /tantivy/0.11.3/tantivy/query/struct.ConstScorer.html
      2 GET /tantivy/0.11.3/tantivy/query/struct.Union.html
      2 GET /tantivy/0.11.3/tantivy/schema/constant.STRING.html
      2 GET /tantivy/0.11.3/tantivy/schema/enum.FieldType.html
      2 GET /tantivy/0.11.3/tantivy/schema/enum.Type.html
      2 GET /tantivy/0.11.3/tantivy/schema/enum.Value.html
      2 GET /tantivy/0.11.3/tantivy/schema/struct.FieldEntry.html
      2 GET /tantivy/0.11.3/tantivy/schema/struct.NamedFieldDocument.html
      2 GET /tantivy/0.11.3/tantivy/store/constant.COMPRESSION.html
      2 GET /tantivy/0.11.3/tantivy/store/sidebar-items.js
      2 GET /tantivy/0.11.3/tantivy/struct.IndexWriter.html?search=postings
      2 GET /tantivy/0.11.3/tantivy/struct.Version.html
      2 GET /tantivy/0.11.3/tantivy/termdict/sidebar-items.js
      2 GET /tantivy/0.11.3/tantivy/termdict/struct.TermDictionaryBuilder.html
      2 GET /tantivy/0.11.3/tantivy/termdict/struct.TermStreamer.html
      2 GET /tantivy/0.11.3/tantivy/tokenizer/struct.RemoveLongFilter.html
      2 GET /tantivy/0.11.3/x86_64-pc-windows-msvc/aliases-20191219-1.42.0-nightly-0de96d37f.js
      2 GET /tantivy/0.11.3/x86_64-pc-windows-msvc/search-index-20191219-1.42.0-nightly-0de96d37f.js
      2 GET /tantivy/0.2.0/tantivy/collector/trait.Collector.html
      2 GET /tantivy/0.2.0/tantivy/schema/index.html
      2 GET /tantivy/0.2.0/tantivy/sidebar-items.js
      2 GET /tantivy/0.3.1/search-index.js
      2 GET /tantivy/0.4.2/search-index.js
      2 GET /tantivy/0.4.3/src/tantivy/schema/schema.rs.html
      2 GET /tantivy/0.4.3/tantivy/
      2 GET /tantivy/0.4.3/tantivy/postings/
      2 GET /tantivy/0.4.3/tantivy/postings/index.html
      2 GET /tantivy/0.4.3/tantivy/postings/trait.Postings.html
      2 GET /tantivy/0.4.3/tantivy/schema/sidebar-items.js
      2 GET /tantivy/0.4.3/tantivy/schema/struct.IntOptions.html
      2 GET /tantivy/0.4.3/tantivy/sidebar-items.js
      2 GET /tantivy/0.4.3/tantivy/struct.DocAddress.html
      2 GET /tantivy/0.4.3/tantivy/struct.IndexWriter.html
      2 GET /tantivy/0.5.0/search-index.js
      2 GET /tantivy/0.5.1/x86_64-apple-darwin/search-index.js
      2 GET /tantivy/0.6.0/implementors/tantivy/query/trait.Scorer.js
      2 GET /tantivy/0.6.0/settings.html
      2 GET /tantivy/0.6.0/tantivy/fieldnorm/index.html
      2 GET /tantivy/0.6.0/tantivy/query/sidebar-items.js
      2 GET /tantivy/0.6.0/tantivy/query/trait.Scorer.html
      2 GET /tantivy/0.6.0/tantivy/tokenizer/sidebar-items.js
      2 GET /tantivy/0.7.0/i686-apple-darwin/tantivy/schema/sidebar-items.js
      2 GET /tantivy/0.7.0/i686-pc-windows-msvc/aliases.js
      2 GET /tantivy/0.7.0/i686-pc-windows-msvc/search-index.js
      2 GET /tantivy/0.7.0/src/tantivy/tokenizer/stop_word_filter.rs.html
      2 GET /tantivy/0.7.0/tantivy/query/sidebar-items.js
      2 GET /tantivy/0.7.0/tantivy/schema/enum.Value.html
      2 GET /tantivy/0.7.0/tantivy/schema/sidebar-items.js
      2 GET /tantivy/0.7.1/i686-apple-darwin/tantivy/fastfield/sidebar-items.js
      2 GET /tantivy/0.7.1/tantivy/
      2 GET /tantivy/0.8.0/source-files.js
      2 GET /tantivy/0.8.0/source-script-20181217-1.33.0-nightly-adbfec229.js
      2 GET /tantivy/0.8.0/src/tantivy/fastfield/multivalued/writer.rs.html
      2 GET /tantivy/0.8.0/tantivy/
      2 GET /tantivy/0.8.0/tantivy/sidebar-items.js
      2 GET /tantivy/0.8.1/tantivy/
      2 GET /tantivy/0.8.1/tantivy/schema/enum.Value.html
      2 GET /tantivy/0.8.1/tantivy/struct.Document.html
      2 GET /tantivy/0.8.1/x86_64-apple-darwin/aliases.js
      2 GET /tantivy/0.8.1/x86_64-apple-darwin/search-index.js
      2 GET /tantivy/0.8.1/x86_64-apple-darwin/tantivy/query/enum.QueryParserError.html
      2 GET /tantivy/0.8.1/x86_64-apple-darwin/tantivy/query/sidebar-items.js
      2 GET /tantivy/0.9.0/tantivy/
      2 GET /tantivy/0.9.1/tantivy/collector/sidebar-items.js
      3 GET /tantivy/%5E0.11
      3 GET /tantivy/0.10.0/tantivy/schema/enum.Value.html
      3 GET /tantivy/0.10.0/tantivy/struct.Searcher.html
      3 GET /tantivy/0.10.2/tantivy/collector/trait.Collector.html
      3 GET /tantivy/0.10.2/tantivy/directory/index.html
      3 GET /tantivy/0.10.2/tantivy/query/struct.BooleanQuery.html
      3 GET /tantivy/0.10.2/tantivy/schema/index.html
      3 GET /tantivy/0.10.2/tantivy/schema/sidebar-items.js
      3 GET /tantivy/0.10.2/tantivy/struct.IndexWriter.html
      3 GET /tantivy/0.10.3/tantivy/enum.SkipResult.html
      3 GET /tantivy/0.10.3/tantivy/query/struct.EmptyQuery.html
      3 GET /tantivy/0.10.3/tantivy/query/struct.Exclude.html
      3 GET /tantivy/0.10.3/tantivy/struct.Segment.html
      3 GET /tantivy/0.11.0/tantivy/
      3 GET /tantivy/0.11.2/tantivy/
      3 GET /tantivy/0.11.3/implementors/tantivy/tokenizer/trait.TokenStream.js
      3 GET /tantivy/0.11.3/implementors/tantivy/trait.DocSet.js
      3 GET /tantivy/0.11.3/postings/struct.TermInfo.html
      3 GET /tantivy/0.11.3/src/tantivy/fastfield/mod.rs.html
      3 GET /tantivy/0.11.3/src/tantivy/indexer/log_merge_policy.rs.html
      3 GET /tantivy/0.11.3/src/tantivy/postings/postings.rs.html
      3 GET /tantivy/0.11.3/src/tantivy/tokenizer/alphanum_only.rs.html
      3 GET /tantivy/0.11.3/tantivy/directory/struct.RAMDirectory.html
      3 GET /tantivy/0.11.3/tantivy/enum.Error.html
      3 GET /tantivy/0.11.3/tantivy/fastfield/sidebar-items.js
      3 GET /tantivy/0.11.3/tantivy/fastfield/struct.FastFieldReaders.html
      3 GET /tantivy/0.11.3/tantivy/fastfield/struct.FastFieldsWriter.html
      3 GET /tantivy/0.11.3/tantivy/fn.i64_to_u64.html
      3 GET /tantivy/0.11.3/tantivy/fn.u64_to_i64.html
      3 GET /tantivy/0.11.3/tantivy/fn.version.html
      3 GET /tantivy/0.11.3/tantivy/fn.version_string.html
      3 GET /tantivy/0.11.3/tantivy/postings/struct.TermInfo.html
      3 GET /tantivy/0.11.3/tantivy/query/struct.RequiredOptionalScorer.html
      3 GET /tantivy/0.11.3/tantivy/store/struct.StoreReader.html
      3 GET /tantivy/0.11.3/tantivy/tokenizer/struct.AsciiFoldingFilter.html
      3 GET /tantivy/0.11.3/tantivy/tokenizer/struct.PreTokenizedString.html
      3 GET /tantivy/0.11.3/tantivy/tokenizer/struct.SimpleTokenizer.html
      3 GET /tantivy/0.11.3/tantivy/tokenizer/struct.Token.html
      3 GET /tantivy/0.11.3/tantivy/trait.Directory.html
      3 GET /tantivy/0.11.3/tantivy/type.SegmentLocalId.html
      3 GET /tantivy/0.2.0/tantivy/struct.SegmentReader.html
      3 GET /tantivy/0.3.1/tantivy/
      3 GET /tantivy/0.4.3/tantivy/schema/
      3 GET /tantivy/0.4.4/tantivy/
      3 GET /tantivy/0.5.0/tantivy/
      3 GET /tantivy/0.7.0/i686-apple-darwin/tantivy/query/sidebar-items.js
      3 GET /tantivy/0.7.0/i686-apple-darwin/tantivy/query/struct.RegexQuery.html
      3 GET /tantivy/0.7.0/tantivy/
      3 GET /tantivy/0.7.0/tantivy/query/struct.FuzzyTermQuery.html
      3 GET /tantivy/0.7.0/tantivy/query/struct.QueryParser.html
      3 GET /tantivy/0.7.0/tantivy/sidebar-items.js
      3 GET /tantivy/0.7.2/light-20181217-1.33.0-nightly-adbfec229.css
      3 GET /tantivy/0.7.2/rustdoc-20181217-1.33.0-nightly-adbfec229.css
      3 GET /tantivy/0.7.2/settings.html
      3 GET /tantivy/0.7.2/storage-20181217-1.33.0-nightly-adbfec229.js
      3 GET /tantivy/0.8.0/brush-20181217-1.33.0-nightly-adbfec229.svg
      3 GET /tantivy/0.8.0/dark-20181217-1.33.0-nightly-adbfec229.css
      3 GET /tantivy/0.8.0/down-arrow-20181217-1.33.0-nightly-adbfec229.svg
      3 GET /tantivy/0.8.0/light-20181217-1.33.0-nightly-adbfec229.css
      3 GET /tantivy/0.8.0/normalize-20181217-1.33.0-nightly-adbfec229.css
      3 GET /tantivy/0.8.0/rustdoc-20181217-1.33.0-nightly-adbfec229.css
      3 GET /tantivy/0.8.0/storage-20181217-1.33.0-nightly-adbfec229.js
      3 GET /tantivy/0.8.0/tantivy/collector/index.html
      3 GET /tantivy/0.8.0/wheel-20181217-1.33.0-nightly-adbfec229.svg
      3 GET /tantivy/0.9.0/aliases.js
      3 GET /tantivy/0.9.0/search-index.js
      3 GET /tantivy/0.9.1/tantivy/query/index.html
      3 GET /tantivy/0.9.1/tantivy/sidebar-items.js
      4 GET /tantivy/%5E0.9
      4 GET /tantivy/0.1.1/tantivy/
      4 GET /tantivy/0.10.2/source-files-20190923-1.39.0-nightly-66bf391c3.js
      4 GET /tantivy/0.10.3/source-files-20191109-1.40.0-nightly-ac162c6ab.js
      4 GET /tantivy/0.10.3/src/tantivy/collector/mod.rs.html
      4 GET /tantivy/0.10.3/tantivy/query/sidebar-items.js
      4 GET /tantivy/0.10.3/tantivy/query/struct.Explanation.html
      4 GET /tantivy/0.10.3/tantivy/query/struct.QueryParser.html
      4 GET /tantivy/0.10.3/tantivy/struct.IndexMeta.html
      4 GET /tantivy/0.11.3/implementors/tantivy/collector/trait.Fruit.js
      4 GET /tantivy/0.11.3/implementors/tantivy/query/trait.Weight.js
      4 GET /tantivy/0.11.3/implementors/tantivy/tokenizer/trait.Tokenizer.js
      4 GET /tantivy/0.11.3/src/tantivy/core/searcher.rs.html
      4 GET /tantivy/0.11.3/src/tantivy/query/boolean_query/boolean_query.rs.html
      4 GET /tantivy/0.11.3/tantivy/collector/struct.FacetCollector.html
      4 GET /tantivy/0.11.3/tantivy/directory/struct.ManagedDirectory.html
      4 GET /tantivy/0.11.3/tantivy/fastfield/struct.MultiValueIntFastFieldReader.html
      4 GET /tantivy/0.11.3/tantivy/fastfield/trait.FastValue.html
      4 GET /tantivy/0.11.3/tantivy/merge_policy/
      4 GET /tantivy/0.11.3/tantivy/postings/trait.HasLen.html
      4 GET /tantivy/0.11.3/tantivy/query/struct.AllQuery.html
      4 GET /tantivy/0.11.3/tantivy/query/struct.AutomatonWeight.html
      4 GET /tantivy/0.11.3/tantivy/query/struct.Explanation.html
      4 GET /tantivy/0.11.3/tantivy/query/struct.RangeQuery.html
      4 GET /tantivy/0.11.3/tantivy/schema/constant.INDEXED.html
      4 GET /tantivy/0.11.3/tantivy/struct.SegmentId.html
      4 GET /tantivy/0.11.3/tantivy/tokenizer/enum.Language.html
      4 GET /tantivy/0.11.3/tantivy/tokenizer/struct.AlphaNumOnlyFilter.html
      4 GET /tantivy/0.11.3/tantivy/tokenizer/struct.BoxedTokenizer.html
      4 GET /tantivy/0.11.3/tantivy/tokenizer/struct.Stemmer.html
      4 GET /tantivy/0.11.3/tantivy/trait.Postings.html
      4 GET /tantivy/0.11.3/x86_64-pc-windows-msvc/tantivy/
      4 GET /tantivy/0.4.2/tantivy/
      4 GET /tantivy/0.4.3/tantivy/schema/struct.Schema.html
      4 GET /tantivy/0.6.0/tantivy/tokenizer/struct.NgramTokenizer.html
      4 GET /tantivy/0.7.0/i686-apple-darwin/search-index.js
      4 GET /tantivy/0.7.2/brush-20181217-1.33.0-nightly-adbfec229.svg
      4 GET /tantivy/0.7.2/dark-20181217-1.33.0-nightly-adbfec229.css
      4 GET /tantivy/0.7.2/down-arrow-20181217-1.33.0-nightly-adbfec229.svg
      4 GET /tantivy/0.7.2/normalize-20181217-1.33.0-nightly-adbfec229.css
      4 GET /tantivy/0.7.2/tantivy/sidebar-items.js
      4 GET /tantivy/0.7.2/wheel-20181217-1.33.0-nightly-adbfec229.svg
      4 GET /tantivy/0.8.0/aliases.js
      4 GET /tantivy/0.8.0/main-20181217-1.33.0-nightly-adbfec229.js
      4 GET /tantivy/0.8.0/search-index.js
      4 GET /tantivy/0.8.0/theme-20181217-1.33.0-nightly-adbfec229.js
      4 GET /tantivy/0.9.1/tantivy/query/struct.QueryParser.html
      5 GET /tantivy/0.10.2/implementors/tantivy/trait.DocSet.js
      5 GET /tantivy/0.11.3/src/tantivy/postings/segment_postings.rs.html
      5 GET /tantivy/0.11.3/tantivy/all.html
      5 GET /tantivy/0.11.3/tantivy/enum.ReloadPolicy.html
      5 GET /tantivy/0.11.3/tantivy/fn.f64_to_u64.html
      5 GET /tantivy/0.11.3/tantivy/merge_policy/struct.LogMergePolicy.html
      5 GET /tantivy/0.11.3/tantivy/postings/sidebar-items.js
      5 GET /tantivy/0.11.3/tantivy/postings/struct.BlockSegmentPostings.html
      5 GET /tantivy/0.11.3/tantivy/schema/constant.STORED.html
      5 GET /tantivy/0.11.3/tantivy/schema/constant.TEXT.html
      5 GET /tantivy/0.11.3/tantivy/struct.LeasedItem.html
      5 GET /tantivy/0.11.3/tantivy/struct.SegmentMeta.html
      5 GET /tantivy/0.11.3/tantivy/tokenizer/sidebar-items.js
      5 GET /tantivy/0.11.3/tantivy/tokenizer/struct.NgramTokenizer.html
      5 GET /tantivy/0.11.3/tantivy/tokenizer/struct.StopWordFilter.html
      5 GET /tantivy/0.11.3/tantivy/trait.DocSet.html
      5 GET /tantivy/0.11.3/tantivy/type.DateTime.html
      5 GET /tantivy/0.4.3/search-index.js
      5 GET /tantivy/0.4.3/tantivy/schema/struct.SchemaBuilder.html
      5 GET /tantivy/0.7.0/i686-apple-darwin/aliases.js
      5 GET /tantivy/0.7.2/aliases.js
      5 GET /tantivy/0.7.2/main-20181217-1.33.0-nightly-adbfec229.js
      5 GET /tantivy/0.7.2/search-index.js
      5 GET /tantivy/0.7.2/theme-20181217-1.33.0-nightly-adbfec229.js
      5 GET /tantivy/0.8.1/tantivy/sidebar-items.js
      6 GET /tantivy/0.10.0/tantivy/
      6 GET /tantivy/0.10.1/tantivy/
      6 GET /tantivy/0.10.2/tantivy/query/sidebar-items.js
      6 GET /tantivy/0.11.3/implementors/tantivy/collector/trait.Collector.js
      6 GET /tantivy/0.11.3/tantivy/collector/trait.Fruit.html
      6 GET /tantivy/0.11.3/tantivy/fieldnorm/index.html
      6 GET /tantivy/0.11.3/tantivy/macro.doc.html
      6 GET /tantivy/0.11.3/tantivy/merge_policy/index.html
      6 GET /tantivy/0.11.3/tantivy/schema/struct.Document.html
      6 GET /tantivy/0.11.3/tantivy/schema/struct.Facet.html
      6 GET /tantivy/0.11.3/tantivy/struct.IndexReaderBuilder.html
      6 GET /tantivy/0.11.3/tantivy/struct.InvertedIndexReader.html
      6 GET /tantivy/0.11.3/tantivy/termdict/struct.TermDictionary.html
      6 GET /tantivy/0.11.3/tantivy/tokenizer/
      6 GET /tantivy/0.11.3/tantivy/tokenizer/struct.TokenizerManager.html
      6 GET /tantivy/0.11.3/tantivy/tokenizer/trait.TokenStream.html
      6 GET /tantivy/0.11.3/tantivy/type.Opstamp.html
      6 GET /tantivy/0.6.0/aliases.js
      6 GET /tantivy/0.6.0/search-index.js
      6 GET /tantivy/0.9.1/search-index.js
      7 GET /tantivy/0.10.2/tantivy/trait.DocSet.html
      7 GET /tantivy/0.11.3/implementors/tantivy/directory/trait.Directory.js
      7 GET /tantivy/0.11.3/implementors/tantivy/query/trait.Query.js
      7 GET /tantivy/0.11.3/src/tantivy/core/index.rs.html
      7 GET /tantivy/0.11.3/tantivy/fastfield/struct.FastFieldReader.html
      7 GET /tantivy/0.11.3/tantivy/postings/
      7 GET /tantivy/0.11.3/tantivy/postings/trait.Postings.html
      7 GET /tantivy/0.11.3/tantivy/schema/struct.IntOptions.html
      7 GET /tantivy/0.11.3/tantivy/type.Score.html
      7 GET /tantivy/0.2.0/search-index.js
      7 GET /tantivy/0.8.1/aliases.js
      7 GET /tantivy/0.8.1/search-index.js
      7 GET /tantivy/0.8.1/tantivy/struct.Index.html
      7 GET /tantivy/0.9.1/aliases.js
      7 GET /tantivy/0.9.1/tantivy/
      8 GET /tantivy/0.10.3/aliases-20191109-1.40.0-nightly-ac162c6ab.js
      8 GET /tantivy/0.11.3/tantivy/directory/sidebar-items.js
      8 GET /tantivy/0.11.3/tantivy/postings/struct.SegmentPostings.html
      8 GET /tantivy/0.11.3/tantivy/query/trait.Weight.html
      8 GET /tantivy/0.11.3/tantivy/schema/constant.FAST.html
      8 GET /tantivy/0.11.3/tantivy/schema/struct.Field.html
      8 GET /tantivy/0.11.3/tantivy/space_usage/index.html
      8 GET /tantivy/0.11.3/tantivy/struct.Snippet.html
      8 GET /tantivy/0.11.3/tantivy/struct.SnippetGenerator.html
      8 GET /tantivy/0.11.3/tantivy/termdict/index.html
      8 GET /tantivy/0.11.3/tantivy/tokenizer/trait.Tokenizer.html
      8 GET /tantivy/0.11.3/tantivy/type.Result.html
      8 GET /tantivy/0.7.0/aliases.js
      8 GET /tantivy/0.7.0/tantivy/query/index.html
      9 GET /tantivy/0.10.3/search-index-20191109-1.40.0-nightly-ac162c6ab.js
      9 GET /tantivy/0.10.3/tantivy/sidebar-items.js
      9 GET /tantivy/0.11.3/tantivy/collector/sidebar-items.js
      9 GET /tantivy/0.11.3/tantivy/merge_policy/trait.MergePolicy.html
      9 GET /tantivy/0.11.3/tantivy/postings/index.html
      9 GET /tantivy/0.11.3/tantivy/struct.Segment.html
      9 GET /tantivy/0.11.3/tantivy/struct.Term.html
      9 GET /tantivy/0.7.0/search-index.js
     10 GET /tantivy/0.10.2/tantivy/
     10 GET /tantivy/0.11.3/tantivy/query/struct.PhraseQuery.html
     10 GET /tantivy/0.11.3/tantivy/schema/enum.IndexRecordOption.html
     10 GET /tantivy/0.11.3/tantivy/schema/sidebar-items.js
     10 GET /tantivy/0.11.3/tantivy/store/index.html
     10 GET /tantivy/0.11.3/tantivy/type.DocId.html
     11 GET /tantivy/0.10.2/tantivy/sidebar-items.js
     11 GET /tantivy/0.10.3/tantivy/
     11 GET /tantivy/0.11.3/tantivy/collector/struct.TopDocs.html
     11 GET /tantivy/0.11.3/tantivy/collector/trait.Collector.html
     11 GET /tantivy/0.11.3/tantivy/query/sidebar-items.js
     11 GET /tantivy/0.11.3/tantivy/query/struct.BooleanQuery.html
     11 GET /tantivy/0.11.3/tantivy/schema/
     11 GET /tantivy/0.2.0/tantivy/
     12 GET /tantivy/0.11.3/source-files-20191219-1.42.0-nightly-0de96d37f.js
     12 GET /tantivy/0.11.3/tantivy/directory/index.html
     12 GET /tantivy/0.11.3/tantivy/directory/struct.MmapDirectory.html
     12 GET /tantivy/0.11.3/tantivy/schema/struct.TextFieldIndexing.html
     12 GET /tantivy/0.11.3/tantivy/struct.DocAddress.html
     12 GET /tantivy/0.11.3/tantivy/struct.IndexMeta.html
     12 GET /tantivy/0.11.3/tantivy/struct.SegmentReader.html
     13 GET /tantivy/0.11.3/tantivy/fastfield/index.html
     13 GET /tantivy/0.11.3/tantivy/query/struct.FuzzyTermQuery.html
     13 GET /tantivy/0.11.3/tantivy/query/trait.Query.html
     13 GET /tantivy/0.11.3/tantivy/struct.Document.html
     14 GET /tantivy/0.10.2/aliases-20190923-1.39.0-nightly-66bf391c3.js
     14 GET /tantivy/0.10.2/search-index-20190923-1.39.0-nightly-66bf391c3.js
     14 GET /tantivy/0.11.3/tantivy/query/struct.RegexQuery.html
     14 GET /tantivy/0.11.3/tantivy/query/struct.TermQuery.html
     14 GET /tantivy/0.11.3/tantivy/schema/struct.TextOptions.html
     15 GET /tantivy/0.11.3/tantivy/directory/trait.Directory.html
     15 GET /tantivy/0.11.3/tantivy/schema/struct.Schema.html
     15 GET /tantivy/0.11.3/tantivy/struct.IndexReader.html
     17 GET /tantivy/0.11.3/tantivy/collector/index.html
     19 GET /tantivy/0.11.3/tantivy/schema/struct.SchemaBuilder.html
     20 GET /tantivy/0.11.3/search-index-20191219-1.42.0-nightly-0de96d37f.js
     20 GET /tantivy/0.11.3/tantivy/sidebar-items.js
     21 GET /tantivy/0.11.3/aliases-20191219-1.42.0-nightly-0de96d37f.js
     21 GET /tantivy/0.11.3/tantivy/query/struct.QueryParser.html
     25 GET /tantivy/0.11.3/tantivy/tokenizer/index.html
     27 GET /tantivy/0.11.3/tantivy/struct.IndexWriter.html
     32 GET /tantivy/0.11.3/tantivy/struct.Searcher.html
     43 GET /tantivy/0.11.3/tantivy/query/index.html
     43 GET /tantivy/0.11.3/tantivy/struct.Index.html
     48 GET /tantivy/0.11.3/tantivy/schema/index.html
     65 GET /tantivy/0.11.3/tantivy/index.html
     96 GET /tantivy/
    194 GET /tantivy/0.11.3/tantivy/

jyn514 avatar Feb 12 '20 23:02 jyn514

Hey @jyn514 - thanks for providing this.

Should be helpful in tackling most important/least documented pages.

Is there any scope to extend this log summaries in the future, so maintainers can keep improving documentation using this information?

petr-tik avatar Feb 19 '20 23:02 petr-tik

It would be a fairly large time and storage investment (where would we store the logs?). I would be willing to take a PR adding this, but I don't plan to add it myself any time soon.

jyn514 avatar Feb 20 '20 00:02 jyn514

Small update here:

since we cache in the CDN now, this tracking would either have to be JS, or based on the CDN logs.

syphar avatar Oct 21 '24 04:10 syphar