Ex. 2 Question 7.3

[slaurila]

I suggest that the files
root://cmseos.fnal.gov//store/user/cmsdas/2020/pre_exercises/Set2/DYJetsToLL.root
root://cmseos.fnal.gov//store/user/cmsdas/2020/pre_exercises/Set2/DoubleMuon.root
are moved from FNAL EOS to CERN EOS to make them accessible from lxplus.

[lecriste]

Our folder on lxplus is
/afs/cern.ch/cms/Tutorials/CMSDASatCERN20/

Shall we create one also on EOS to make the files accessible remotely too?
Feel free to update the twikis accordingly.

[slaurila]

I think it would make sense to collect all code in the Tutorials/CMSDASatCERN20 AFS directory (or github if you prefer) and all input ROOT files to a separate EOS directory. This would be a bit more "realistic" and consistent with how it is done at FNAL.

[4quarks]

I tried to copy the files to /afs/cern.ch/cms/Tutorials/CMSDASatCERN20/ but it don't have enough memory available

$ xrdcp -f root://cmseos.fnal.gov//store/user/cmsdas/2020/pre_exercises/Set2/DoubleMuon.root /afs/cern.ch/cms/Tutorials/CMSDASatCERN20/

Run: [ERROR] Server responded with an error: [3021] Disk quota exceeded (destination)

[mulders]

is it possible/easy to get a cmsdas/2020 folder on eos? I would rather store largish data files there than in the AFS tutorial directory, even though some others have abused it with several GB of root files

[4quarks]

We could create a user DAS2020 and store all the information at "/eos/cms/store/user/DAS2020". I tried to write on different paths but it seems that you need admin permissions. I will continue to investigate if there's a better way to do it but this could be an option

[slaurila]

As @clelange suggested in Discord, we should probably ask for a group EOS storage space. Did someone do it already?
But since reading from FNAL works also fine (it just can be slow sometimes), we don't need to wait for our EOS before announcing the pre-exercises, right?
But for short and long exercises, having our own group EOS space will surely be useful in any case.

[4quarks]

I would use FNAL and work on this eos migration in parallel. Then, for the long exercises we would be able to have everything already up to date

[4quarks]

I have copied all the files from FNAL to "/eos/user/c/cmsdas/2020". The ones that I could not are the ones listed here below. It seems that the files are not there anymore... I have to investigate a bit

$ xrdcp -f root://cmseos.fnal.gov//store/user/keanet/DoubleMuon/crab_CMSDAS_Data_analysis_test0/191016_035156/0000/slimMiniAOD_data_MuEle_2.root /eos/user/c/cmsdas/2020/
[0B/0B][100%][==================================================][0B/s]
Run: [ERROR] Server responded with an error: [3011] Unable to open file /eos/uscms/store/user/keanet/DoubleMuon/crab_CMSDAS_Data_analysis_test0/191016_035156/0000/slimMiniAOD_data_MuEle_2.root; No such file or directory (source)

3rd set:

• root://cmseos.fnal.gov//store/user/keanet/DoubleMuon/crab_CMSDAS_Data_analysis_test0/191016_035156/0000/slimMiniAOD_data_MuEle_1.root
• root://cmseos.fnal.gov//store/user/keanet/DoubleMuon/crab_CMSDAS_Data_analysis_test0/191016_035156/0000/slimMiniAOD_data_MuEle_2.root

4th set:

• file:/afs/cern.ch/work/d/dmoon/public/CMSDAS_Files/Exe4/slimMiniAOD_data_MuEle_1.root
• file:/cmsdas/data/pre_exercises/Exe4/slimMiniAOD_data_MuEle_1.root
• file:/pnfs/desy.de/cms/tier2/store/user/your_username/DoubleMuon/crab_CMSDAS_Data_analysis_test0/160718_090558/0000/slimMiniAOD_data_MuEle_1.root

[4quarks]

The files of the 3rd set are not there anymore:
$ xrdfs cmseos.fnal.gov:1094 ls -l /store/user/keanet/
dr-x 2019-04-09 14:59:59 17141454783 /store/user/keanet/CMS_Sim_DelphesTest
dr-x 2020-05-13 21:08:31 138997767 /store/user/keanet/CondorOutput
dr-x 2019-02-20 18:55:01 334351040984 /store/user/keanet/Delphes_root
dr-x 2018-07-18 20:55:52 63717339 /store/user/keanet/MinBias
dr-x 2019-06-13 15:18:01 10 /store/user/keanet/Test
dr-x 2020-03-31 15:31:03 4983758855 /store/user/keanet/schannel
dr-x 2020-07-08 19:17:38 62804013816 /store/user/keanet/tchannel

[4quarks]

I cannot access to the 4th set of files because they are using local file name. Thus, it is only reachable from the worker nodes