Skip to content

Condens LFF operations

Egor Sobolev requested to merge dev/lff-compressed-ops into master

%subj

Example
% exdf-reduce p7859:r166 --lff-source MID_EXP_AGIPD1M1/REDU/LITFRM --lff-det-sources 'MID_DET_AGIPD1M-1/DET/*' -o r166_reduced
INFO:exdf.cli.reduce:Opened data from /gpfs/exfel/exp/MID/202501/p007859/raw/r0166 containing 100 sources and 7677 trains across 752 files
INFO:exdf.data_reduction.builtins.LitFrames:For lit-frame selection use source MID_EXP_AGIPD1M1/REDU/LITFRM
INFO:exdf.data_reduction.builtins.LitFrames: # trains                     Ntrn Nmis   Np  Nd  Nf lit frames
INFO:exdf.data_reduction.builtins.LitFrames: 0 2297060470:2297068145      7675    0    1   1 352 [1]
INFO:exdf.data_reduction.builtins.LitFrames:select frames in MID_DET_AGIPD1M-1/DET/2CH0:xtdf
INFO:exdf.data_reduction.builtins.LitFrames:select frames in MID_DET_AGIPD1M-1/DET/15CH0:xtdf
INFO:exdf.data_reduction.builtins.LitFrames:select frames in MID_DET_AGIPD1M-1/DET/4CH0:xtdf
INFO:exdf.data_reduction.builtins.LitFrames:select frames in MID_DET_AGIPD1M-1/DET/0CH0:xtdf
INFO:exdf.data_reduction.builtins.LitFrames:select frames in MID_DET_AGIPD1M-1/DET/7CH0:xtdf
INFO:exdf.data_reduction.builtins.LitFrames:select frames in MID_DET_AGIPD1M-1/DET/3CH0:xtdf
INFO:exdf.data_reduction.builtins.LitFrames:select frames in MID_DET_AGIPD1M-1/DET/12CH0:xtdf
INFO:exdf.data_reduction.builtins.LitFrames:select frames in MID_DET_AGIPD1M-1/DET/9CH0:xtdf
INFO:exdf.data_reduction.builtins.LitFrames:select frames in MID_DET_AGIPD1M-1/DET/11CH0:xtdf
INFO:exdf.data_reduction.builtins.LitFrames:select frames in MID_DET_AGIPD1M-1/DET/10CH0:xtdf
INFO:exdf.data_reduction.builtins.LitFrames:select frames in MID_DET_AGIPD1M-1/DET/8CH0:xtdf
INFO:exdf.data_reduction.builtins.LitFrames:select frames in MID_DET_AGIPD1M-1/DET/13CH0:xtdf
INFO:exdf.data_reduction.builtins.LitFrames:select frames in MID_DET_AGIPD1M-1/DET/1CH0:xtdf
INFO:exdf.data_reduction.builtins.LitFrames:select frames in MID_DET_AGIPD1M-1/DET/14CH0:xtdf
INFO:exdf.data_reduction.builtins.LitFrames:select frames in MID_DET_AGIPD1M-1/DET/5CH0:xtdf
INFO:exdf.data_reduction.builtins.LitFrames:select frames in MID_DET_AGIPD1M-1/DET/6CH0:xtdf
INFO:exdf.cli.reduce:Applying LitFrames with 1 reduction operations
INFO:exdf.cli.reduce:Writing collection to /gpfs/exfel/u/scratch/MID/202501/p007859/lff/r166_reduced
INFO:exdf.data_reduction.ReduceWriter:RAW-AGIPD00 containing 1 sources with 7676 trains over 31 sequences
INFO:exdf.data_reduction.ReduceWriter:RAW-AGIPD10 containing 1 sources with 7676 trains over 31 sequences
INFO:exdf.data_reduction.ReduceWriter:RAW-AGIPD11 containing 1 sources with 7676 trains over 31 sequences
INFO:exdf.data_reduction.ReduceWriter:RAW-AGIPD12 containing 1 sources with 7676 trains over 31 sequences
INFO:exdf.data_reduction.ReduceWriter:RAW-AGIPD13 containing 1 sources with 7676 trains over 31 sequences
INFO:exdf.data_reduction.ReduceWriter:RAW-AGIPD14 containing 1 sources with 7676 trains over 31 sequences
INFO:exdf.data_reduction.ReduceWriter:RAW-AGIPD15 containing 1 sources with 7676 trains over 31 sequences
INFO:exdf.data_reduction.ReduceWriter:RAW-AGIPD01 containing 1 sources with 7676 trains over 31 sequences
INFO:exdf.data_reduction.ReduceWriter:RAW-AGIPD02 containing 1 sources with 7676 trains over 31 sequences
INFO:exdf.data_reduction.ReduceWriter:RAW-AGIPD03 containing 1 sources with 7676 trains over 31 sequences
INFO:exdf.data_reduction.ReduceWriter:RAW-AGIPD04 containing 1 sources with 7676 trains over 31 sequences
INFO:exdf.data_reduction.ReduceWriter:RAW-AGIPD05 containing 1 sources with 7676 trains over 31 sequences
INFO:exdf.data_reduction.ReduceWriter:RAW-AGIPD06 containing 1 sources with 7676 trains over 31 sequences
INFO:exdf.data_reduction.ReduceWriter:RAW-AGIPD07 containing 1 sources with 7676 trains over 31 sequences
INFO:exdf.data_reduction.ReduceWriter:RAW-AGIPD08 containing 1 sources with 7676 trains over 31 sequences
INFO:exdf.data_reduction.ReduceWriter:RAW-AGIPD09 containing 1 sources with 7676 trains over 31 sequences

@schmidtp

Edited by Egor Sobolev

Merge request reports

Loading