Jerry Ling

Results 327 comments of Jerry Ling

ROOT is happy with the (empty file) footer for now ```python In [16]: with up.recreate("/tmp/test.root") as file: ...: akform = ak._v2.forms.RecordForm([ak._v2.forms.NumpyForm('int32')], ['one_integers']) ...: file.mkntuple("ntuple", akform) In [17]: ROOT.Experimental.RNTupleReader.Open("ntuple", "/tmp/test.root").PrintInfo() [ROOT.NTuple]...

```python In [73]: with up.recreate("/tmp/test.root") as file: ...: akform = ak._v2.forms.RecordForm([ak._v2.forms.NumpyForm('int32')], ['one_integers ...: ']) ...: file.mkntuple("ntuple", akform) ...: print(type(file)) ...: a = file["ntuple"] ...: print(type(a)) ```

```python In [28]: with up.recreate("/tmp/test.root") as file: ...: akform = ak._v2.forms.RecordForm([ak._v2.forms.NumpyForm('int32')], ['one_integers ...: ']) ...: file.mkntuple("ntuple", akform) ...: a = file["ntuple"] ...: a.extend(array) ...: file.close() In [29]: up.open("/tmp/test.root")["ntuple"].footer Out[29]: MetaData('Footer',...

reminder that the list of list of list (of pages) is real: (file from: - https://github.com/scikit-hep/uproot5/pull/682 ) ```python ref = up.open("/home/akako/Documents/github/scikit-hep-testdata/src/skhep_testdata/data/test_ntuple_large_bit_int64.root")["ntuple"] In [6]: ref.page_list_envelopes.pagelinklist Out[6]: [[InnerListLocator(, Cursor(20), num_pages=170), InnerListLocator(, Cursor(2760),...

for maintainers' sanity, increased the eagerness of some footer reading so you can see the list of list of list structure directly instead of following an indirection via the (fake,...

```python In [149]: array Out[149]: In [150]: with up.recreate("/tmp/test.root") as file: ...: akform = ak._v2.forms.RecordForm([ak._v2.forms.NumpyForm('int32')], ['one_integers']) ...: file.mkntuple("ntuple", akform) ...: a = file["ntuple"] ...: a.extend(array) ...: file.close() ...: rn =...

this is the whole thing we do un UnROOT.jl for a physics-community only thing called `TTree`, their next-gen storage called `RNTuple` is basically Apache Feather: https://indico.cern.ch/event/1208767/contributions/5083082/attachments/2523220/4340111/PPP_uproot_RNTuple.pdf#page=13 while we will get...

as an example and for posterity: ```julia julia> using ClusterManagers, Distributed julia> addprocs(HTCManager(1); exeflags = `-e 'include("/home/jiling/.julia-htc/init.jl")'`) ``` content of `init.jl`: ```julia using Sockets import Sockets: getipaddr function getipaddr(addr_type::Type{T}) where...

last time I think @tanmaykm looked at Condor related stuff

It's designed to run on big batches, look at the slides