Issue5348

Title Moving files with srmcp
Priority normal Status resolved
Superseder Nosy List ajit, bachtis, dan, dasu, rader, radtke, wcmaier
Assigned To Topic CMS, dCache
Group IT

Created 2008.07.09 05:26 by bachtis.
Last changed 2008.08.04 08:32 by wcmaier.

Messages
msg14563 (view) From: dan To: ajit, bachtis, dan, dasu, rader, radtke, wcmaier Date: 2008.07.23 12:27
FYI: I generally use the --retry_num=0 option to srmcp, because the 
retries are almost always useless.

--Dan

Ajit Mohapatra via UW-HEP Help System wrote:

>Hi Mike,
>
>Did you try the following command (it was in my email below) ?
>
>srmcp -debug=true 
>srm://cmssrm.hep.wisc.edu:8443//pnfs/hep.wisc.edu/data5/uscms01/bachtis/ZTT50K-HLT-ZtautauRECO/ZtautauRECO-ZTT50K-HLT-0499.root 
> 
>srm://srm-cms.cern.ch:8443/srm/managerv2?SFN=/castor/cern.ch/user/b/bachtis/samples/Ztautau-50K-207/file491.root 
>
>
>If so, please give me the full output (the one below is not very useful ;-) )
>
>Thanks,
>- Ajit
>
>
>  
>
>>Hi Ajit,
>>I made one more try on this
>>
>>so now I get this error:
>>
>>SRMClientV1 : copy: try # 0 failed with error
>>SRMClientV1 : java.net.SocketException: Connection reset
>>Exception in thread "main" java.lang.RuntimeException: 
>>java.net.SocketException\
>>: Connection reset
>>       at org.dcache.srm.client.SRMClientV1.copy(SRMClientV1.java:780)
>>       at gov.fnal.srm.util.SRMCopyClientV1.start(SRMCopyClientV1.java:144)
>>       at gov.fnal.srm.util.SRMDispatcher.work(SRMDispatcher.java:779)
>>       at gov.fnal.srm.util.SRMDispatcher.main(SRMDispatcher.java:372)
>>Tue Jul 22 03:52:57 CDT 2008: setting all remaining file statuses of 
>>request re\
>>questId=0 to "Done"
>>Tue Jul 22 03:52:57 CDT 2008: set all file statuses to "Done"
>>Storage Resource Manager (SRM) CP Client version 2.0
>>Copyright (c) 2002-2006 Fermi National Accelerator Laboratory
>>
>>Ajit Mohapatra via UW-HEP Help System wrote:
>>
>>    
>>
>>>Hi Mike,
>>>
>>> 
>>>
>>>      
>>>
>>>>Hi Ajit,
>>>>I think I tried from login01
>>>>b) The path exists , I made it :-)
>>>>    
>>>>        
>>>>
>>>Ok.. then try this :
>>>
>>>srmcp -debug=true 
>>>srm://cmssrm.hep.wisc.edu:8443//pnfs/hep.wisc.edu/data5/uscms01/bachtis/ZTT50K-HLT-ZtautauRECO/ZtautauRECO-ZTT50K-HLT-0499.root 
>>> 
>>>srm://srm-cms.cern.ch:8443/srm/managerv2?SFN=/castor/cern.ch/user/b/bachtis/samples/Ztautau-50K-207/file491.root 
>>>
>>>
>>>and see what kind of error you get (the -debug option should printout 
>>>a bunch of stuff).
>>>
>>> 
>>>
>>>      
>>>
>>>>This is not for my jobs,I always use condor.
>>>>I want to move this sample for use by other people that they would 
>>>>like to have it in FNAL or CERN .. Maybe we can do it centrally, I 
>>>>mean can we publish those files to DBS and then phedex them to 
>>>>CERN/FNAL?
>>>>    
>>>>        
>>>>
>>>These samples could be publised into local DBS. But we don't have a 
>>>local DBS setup at Wisconsin yet. Dan and I are working on it. In 
>>>order to publish the datasets into the local DBS, the 
>>>FrameworkJobReport files from your jobs (which produced these root 
>>>files) need to be available. Are they ?
>>>
>>>Once the root files are registered in our local DBS (when we set it 
>>>up), then they will need to migrated to Global DBS and then only can 
>>>be xfer'ed via PhEDEx. But we are not there yet. So for the time 
>>>being, you can either copy it to CERN/FNAL manually or have the users 
>>>who want to access the samples in our dCache by running condor jobs 
>>>locally i.e. we can provide them local accounts here in our cluster 
>>>for that.
>>>
>>>Thanks,
>>>- Ajit
>>>
>>>
>>>
>>>
>>> 
>>>
>>>      
>>>
>>>>Ajit Mohapatra via UW-HEP Help System wrote:
>>>>
>>>>   
>>>>
>>>>        
>>>>
>>>>>Hi Mike,
>>>>>
>>>>>To start with you have got 2 things wrong in your srmcp command 
>>>>>(below) :
>>>>>
>>>>>a) CERN srm doesn't support "managerv1", only "managerv2".
>>>>>b) I am not sure that the path /castor/cern.ch/user/b/bachtis/ 
>>>>>exists in CERN Castor ! Is it ?
>>>>>
>>>>> From which machine you are executing the srmcp command ?
>>>>>
>>>>>Next, why do you want to copy files to CERN from our dCache ? Is 
>>>>>there any problem running your jobs at Wisc ? If so, we should 
>>>>>address that first. As you know, you can submit jobs (to condor) 
>>>>>from your desktop or the login machines here. Also, you can submit 
>>>>>CRAB jobs from anywhere to Wisconsin to run on the samples that we 
>>>>>have on our dCache. If you are having problems with CRAB 
>>>>>submissions, then we need to address that too.
>>>>>
>>>>>Also (as you probably know) we have the FAQ page ( 
>>>>>http://www.hep.wisc.edu/cms/comp/faq.html) available from the "User 
>>>>>Documentation" link from our T2 computing page which contains some 
>>>>>information about accessing/copying files from our dCache. But in 
>>>>>your case, you need to specify the correct path to an (user) area at 
>>>>>CERN Castor if it exits.
>>>>>
>>>>>Thanks,
>>>>>- Ajit
>>>>>
>>>>>
>>>>> 
>>>>>
>>>>>     
>>>>>
>>>>>          
>>>>>
>>>>>>Dear All,
>>>>>>
>>>>>>I am trying to transfer some files from dcache to CERN and I am doing
>>>>>>srmcp  
>>>>>>srm://cmssrm.hep.wisc.edu:8443//pnfs/hep.wisc.edu/data5/uscms01/bachtis/ZTT50K-HLT-ZtautauRECO/ZtautauRECO-ZTT50K-HLT-0499.root 
>>>>>>   
>>>>>>srm://srm.cern.ch:8443//srm/managerv1?SFN=/castor/cern.ch/user/b/bachtis/samples/Ztautau-50K-207/file491.root 
>>>>>>
>>>>>>
>>>>>>
>>>>>>    I get this error:
>>>>>>
>>>>>>    SRMClientV1 : copy: try # 0 failed with error
>>>>>>    SRMClientV1 : CastorSRMCopyInterface.c:184 CCI_initCopyRequest()
>>>>>>    getFileMetaData() failed: SOAP fault (null)
>>>>>>     (errno=0, serrno=0)
>>>>>>    srm client error: CastorSRMCopyInterface.c:184
>>>>>>    CCI_initCopyRequest() getFileMetaData() failed: SOAP fault (null)
>>>>>>     (errno=0, serrno=0)
>>>>>>    java.lang.RuntimeException: CastorSRMCopyInterface.c:184
>>>>>>    CCI_initCopyRequest() getFileMetaData() failed: SOAP fault (null)
>>>>>>     (errno=0, serrno=0)
>>>>>>           at 
>>>>>>org.dcache.srm.client.SRMClientV1.copy(SRMClientV1.java:780)
>>>>>>           at
>>>>>>    gov.fnal.srm.util.SRMCopyClientV1.start(SRMCopyClientV1.java:144)
>>>>>>           at 
>>>>>>gov.fnal.srm.util.SRMDispatcher.work(SRMDispatcher.java:779)
>>>>>>           at 
>>>>>>gov.fnal.srm.util.SRMDispatcher.main(SRMDispatcher.java:372)
>>>>>>
>>>>>>    Any ideas??
>>>>>>
>>>>>>BTW is there any other way to transfer those files ..The sample is 
>>>>>>small and I want to send it
>>>>>>to CERN and FNAL...
>>>>>>Thanks
>>>>>>Mike
>>>>>>
>>>>>>----------
>>>>>>group: IT
>>>>>>messages: 14474
>>>>>>nosy: ajit, bachtis, dan, dasu, rader, radtke, wcmaier
>>>>>>priority: triage
>>>>>>status: unread
>>>>>>title: Moving files with srmcp
>>>>>>
>>>>>>______________________________________
>>>>>>UW-HEP Help System <help@hep.wisc.edu>
>>>>>><https://help.hep.wisc.edu/issue5348>
>>>>>>______________________________________
>>>>>>            
>>>>>>            
>>>>>>
>>>>>----------
>>>>>status: unread -> chatting
>>>>>
>>>>>______________________________________
>>>>>UW-HEP Help System <help@hep.wisc.edu>
>>>>><https://help.hep.wisc.edu/issue5348>
>>>>>______________________________________
>>>>>
>>>>>      
>>>>>          
>>>>>
>>>______________________________________
>>>UW-HEP Help System <help@hep.wisc.edu>
>>><https://help.hep.wisc.edu/issue5348>
>>>______________________________________
>>>
>>>      
>>>
>
>______________________________________
>UW-HEP Help System <help@hep.wisc.edu>
><https://help.hep.wisc.edu/issue5348>
>______________________________________
>  
>
msg14556 (view) From: ajit To: ajit, bachtis, dan, dasu, rader, radtke, wcmaier Date: 2008.07.23 09:21
Hi Mike,

Did you try the following command (it was in my email below) ?

srmcp -debug=true 
srm://cmssrm.hep.wisc.edu:8443//pnfs/hep.wisc.edu/data5/uscms01/bachtis/ZTT50K-HLT-ZtautauRECO/ZtautauRECO-ZTT50K-HLT-0499.root 
 
srm://srm-cms.cern.ch:8443/srm/managerv2?SFN=/castor/cern.ch/user/b/bachtis/samples/Ztautau-50K-207/file491.root 


If so, please give me the full output (the one below is not very useful ;-) )

Thanks,
- Ajit


> Hi Ajit,
> I made one more try on this
> 
> so now I get this error:
> 
> SRMClientV1 : copy: try # 0 failed with error
> SRMClientV1 : java.net.SocketException: Connection reset
> Exception in thread "main" java.lang.RuntimeException: 
> java.net.SocketException\
> : Connection reset
>        at org.dcache.srm.client.SRMClientV1.copy(SRMClientV1.java:780)
>        at gov.fnal.srm.util.SRMCopyClientV1.start(SRMCopyClientV1.java:144)
>        at gov.fnal.srm.util.SRMDispatcher.work(SRMDispatcher.java:779)
>        at gov.fnal.srm.util.SRMDispatcher.main(SRMDispatcher.java:372)
> Tue Jul 22 03:52:57 CDT 2008: setting all remaining file statuses of 
> request re\
> questId=0 to "Done"
> Tue Jul 22 03:52:57 CDT 2008: set all file statuses to "Done"
> Storage Resource Manager (SRM) CP Client version 2.0
> Copyright (c) 2002-2006 Fermi National Accelerator Laboratory
> 
> Ajit Mohapatra via UW-HEP Help System wrote:
> 
>> Hi Mike,
>>
>>  
>>
>>> Hi Ajit,
>>> I think I tried from login01
>>> b) The path exists , I made it :-)
>>>     
>>
>>
>> Ok.. then try this :
>>
>> srmcp -debug=true 
>> srm://cmssrm.hep.wisc.edu:8443//pnfs/hep.wisc.edu/data5/uscms01/bachtis/ZTT50K-HLT-ZtautauRECO/ZtautauRECO-ZTT50K-HLT-0499.root 
>>  
>> srm://srm-cms.cern.ch:8443/srm/managerv2?SFN=/castor/cern.ch/user/b/bachtis/samples/Ztautau-50K-207/file491.root 
>>
>>
>> and see what kind of error you get (the -debug option should printout 
>> a bunch of stuff).
>>
>>  
>>
>>> This is not for my jobs,I always use condor.
>>> I want to move this sample for use by other people that they would 
>>> like to have it in FNAL or CERN .. Maybe we can do it centrally, I 
>>> mean can we publish those files to DBS and then phedex them to 
>>> CERN/FNAL?
>>>     
>>
>>
>> These samples could be publised into local DBS. But we don't have a 
>> local DBS setup at Wisconsin yet. Dan and I are working on it. In 
>> order to publish the datasets into the local DBS, the 
>> FrameworkJobReport files from your jobs (which produced these root 
>> files) need to be available. Are they ?
>>
>> Once the root files are registered in our local DBS (when we set it 
>> up), then they will need to migrated to Global DBS and then only can 
>> be xfer'ed via PhEDEx. But we are not there yet. So for the time 
>> being, you can either copy it to CERN/FNAL manually or have the users 
>> who want to access the samples in our dCache by running condor jobs 
>> locally i.e. we can provide them local accounts here in our cluster 
>> for that.
>>
>> Thanks,
>> - Ajit
>>
>>
>>
>>
>>  
>>
>>> Ajit Mohapatra via UW-HEP Help System wrote:
>>>
>>>    
>>>
>>>> Hi Mike,
>>>>
>>>> To start with you have got 2 things wrong in your srmcp command 
>>>> (below) :
>>>>
>>>> a) CERN srm doesn't support "managerv1", only "managerv2".
>>>> b) I am not sure that the path /castor/cern.ch/user/b/bachtis/ 
>>>> exists in CERN Castor ! Is it ?
>>>>
>>>>  From which machine you are executing the srmcp command ?
>>>>
>>>> Next, why do you want to copy files to CERN from our dCache ? Is 
>>>> there any problem running your jobs at Wisc ? If so, we should 
>>>> address that first. As you know, you can submit jobs (to condor) 
>>>> from your desktop or the login machines here. Also, you can submit 
>>>> CRAB jobs from anywhere to Wisconsin to run on the samples that we 
>>>> have on our dCache. If you are having problems with CRAB 
>>>> submissions, then we need to address that too.
>>>>
>>>> Also (as you probably know) we have the FAQ page ( 
>>>> http://www.hep.wisc.edu/cms/comp/faq.html) available from the "User 
>>>> Documentation" link from our T2 computing page which contains some 
>>>> information about accessing/copying files from our dCache. But in 
>>>> your case, you need to specify the correct path to an (user) area at 
>>>> CERN Castor if it exits.
>>>>
>>>> Thanks,
>>>> - Ajit
>>>>
>>>>
>>>>  
>>>>
>>>>      
>>>>
>>>>> Dear All,
>>>>>
>>>>> I am trying to transfer some files from dcache to CERN and I am doing
>>>>> srmcp  
>>>>> srm://cmssrm.hep.wisc.edu:8443//pnfs/hep.wisc.edu/data5/uscms01/bachtis/ZTT50K-HLT-ZtautauRECO/ZtautauRECO-ZTT50K-HLT-0499.root 
>>>>>    
>>>>> srm://srm.cern.ch:8443//srm/managerv1?SFN=/castor/cern.ch/user/b/bachtis/samples/Ztautau-50K-207/file491.root 
>>>>>
>>>>>
>>>>>
>>>>>     I get this error:
>>>>>
>>>>>     SRMClientV1 : copy: try # 0 failed with error
>>>>>     SRMClientV1 : CastorSRMCopyInterface.c:184 CCI_initCopyRequest()
>>>>>     getFileMetaData() failed: SOAP fault (null)
>>>>>      (errno=0, serrno=0)
>>>>>     srm client error: CastorSRMCopyInterface.c:184
>>>>>     CCI_initCopyRequest() getFileMetaData() failed: SOAP fault (null)
>>>>>      (errno=0, serrno=0)
>>>>>     java.lang.RuntimeException: CastorSRMCopyInterface.c:184
>>>>>     CCI_initCopyRequest() getFileMetaData() failed: SOAP fault (null)
>>>>>      (errno=0, serrno=0)
>>>>>            at 
>>>>> org.dcache.srm.client.SRMClientV1.copy(SRMClientV1.java:780)
>>>>>            at
>>>>>     gov.fnal.srm.util.SRMCopyClientV1.start(SRMCopyClientV1.java:144)
>>>>>            at 
>>>>> gov.fnal.srm.util.SRMDispatcher.work(SRMDispatcher.java:779)
>>>>>            at 
>>>>> gov.fnal.srm.util.SRMDispatcher.main(SRMDispatcher.java:372)
>>>>>
>>>>>     Any ideas??
>>>>>
>>>>> BTW is there any other way to transfer those files ..The sample is 
>>>>> small and I want to send it
>>>>> to CERN and FNAL...
>>>>> Thanks
>>>>> Mike
>>>>>
>>>>> ----------
>>>>> group: IT
>>>>> messages: 14474
>>>>> nosy: ajit, bachtis, dan, dasu, rader, radtke, wcmaier
>>>>> priority: triage
>>>>> status: unread
>>>>> title: Moving files with srmcp
>>>>>
>>>>> ______________________________________
>>>>> UW-HEP Help System <help@hep.wisc.edu>
>>>>> <https://help.hep.wisc.edu/issue5348>
>>>>> ______________________________________
>>>>>             
>>>>
>>>> ----------
>>>> status: unread -> chatting
>>>>
>>>> ______________________________________
>>>> UW-HEP Help System <help@hep.wisc.edu>
>>>> <https://help.hep.wisc.edu/issue5348>
>>>> ______________________________________
>>>>
>>>>       
>>
>>
>> ______________________________________
>> UW-HEP Help System <help@hep.wisc.edu>
>> <https://help.hep.wisc.edu/issue5348>
>> ______________________________________
>>
msg14544 (view) From: bachtis To: ajit, bachtis, dan, dasu, rader, radtke, wcmaier Date: 2008.07.22 03:55
Hi Ajit,
I made one more try on this

so now I get this error:

SRMClientV1 : copy: try # 0 failed with error
SRMClientV1 : java.net.SocketException: Connection reset
Exception in thread "main" java.lang.RuntimeException: 
java.net.SocketException\
: Connection reset
        at org.dcache.srm.client.SRMClientV1.copy(SRMClientV1.java:780)
        at gov.fnal.srm.util.SRMCopyClientV1.start(SRMCopyClientV1.java:144)
        at gov.fnal.srm.util.SRMDispatcher.work(SRMDispatcher.java:779)
        at gov.fnal.srm.util.SRMDispatcher.main(SRMDispatcher.java:372)
Tue Jul 22 03:52:57 CDT 2008: setting all remaining file statuses of 
request re\
questId=0 to "Done"
Tue Jul 22 03:52:57 CDT 2008: set all file statuses to "Done"
Storage Resource Manager (SRM) CP Client version 2.0
Copyright (c) 2002-2006 Fermi National Accelerator Laboratory

Ajit Mohapatra via UW-HEP Help System wrote:
> Hi Mike,
>
>   
>> Hi Ajit,
>> I think I tried from login01
>> b) The path exists , I made it :-)
>>     
>
> Ok.. then try this :
>
> srmcp -debug=true 
> srm://cmssrm.hep.wisc.edu:8443//pnfs/hep.wisc.edu/data5/uscms01/bachtis/ZTT50K-HLT-ZtautauRECO/ZtautauRECO-ZTT50K-HLT-0499.root 
>  
> srm://srm-cms.cern.ch:8443/srm/managerv2?SFN=/castor/cern.ch/user/b/bachtis/samples/Ztautau-50K-207/file491.root 
>
>
> and see what kind of error you get (the -debug option should printout a bunch of 
> stuff).
>
>   
>> This is not for my jobs,I always use condor.
>> I want to move this sample for use by other people that they would like 
>> to have it in FNAL or CERN .. Maybe we can do it centrally, I mean can 
>> we publish those files to DBS and then phedex them to CERN/FNAL?
>>     
>
> These samples could be publised into local DBS. But we don't have a local DBS 
> setup at Wisconsin yet. Dan and I are working on it. In order to publish the 
> datasets into the local DBS, the FrameworkJobReport files from your jobs (which 
> produced these root files) need to be available. Are they ?
>
> Once the root files are registered in our local DBS (when we set it up), then 
> they will need to migrated to Global DBS and then only can be xfer'ed via 
> PhEDEx. But we are not there yet. So for the time being, you can either copy it 
> to CERN/FNAL manually or have the users who want to access the samples in our 
> dCache by running condor jobs locally i.e. we can provide them local accounts 
> here in our cluster for that.
>
> Thanks,
> - Ajit
>
>
>
>
>   
>> Ajit Mohapatra via UW-HEP Help System wrote:
>>
>>     
>>> Hi Mike,
>>>
>>> To start with you have got 2 things wrong in your srmcp command (below) :
>>>
>>> a) CERN srm doesn't support "managerv1", only "managerv2".
>>> b) I am not sure that the path /castor/cern.ch/user/b/bachtis/ exists 
>>> in CERN Castor ! Is it ?
>>>
>>>  From which machine you are executing the srmcp command ?
>>>
>>> Next, why do you want to copy files to CERN from our dCache ? Is there 
>>> any problem running your jobs at Wisc ? If so, we should address that 
>>> first. As you know, you can submit jobs (to condor) from your desktop 
>>> or the login machines here. Also, you can submit CRAB jobs from 
>>> anywhere to Wisconsin to run on the samples that we have on our 
>>> dCache. If you are having problems with CRAB submissions, then we need 
>>> to address that too.
>>>
>>> Also (as you probably know) we have the FAQ page ( 
>>> http://www.hep.wisc.edu/cms/comp/faq.html) available from the "User 
>>> Documentation" link from our T2 computing page which contains some 
>>> information about accessing/copying files from our dCache. But in your 
>>> case, you need to specify the correct path to an (user) area at CERN 
>>> Castor if it exits.
>>>
>>> Thanks,
>>> - Ajit
>>>
>>>
>>>  
>>>
>>>       
>>>> Dear All,
>>>>
>>>> I am trying to transfer some files from dcache to CERN and I am doing
>>>> srmcp  
>>>> srm://cmssrm.hep.wisc.edu:8443//pnfs/hep.wisc.edu/data5/uscms01/bachtis/ZTT50K-HLT-ZtautauRECO/ZtautauRECO-ZTT50K-HLT-0499.root 
>>>>    
>>>> srm://srm.cern.ch:8443//srm/managerv1?SFN=/castor/cern.ch/user/b/bachtis/samples/Ztautau-50K-207/file491.root 
>>>>
>>>>
>>>>
>>>>     I get this error:
>>>>
>>>>     SRMClientV1 : copy: try # 0 failed with error
>>>>     SRMClientV1 : CastorSRMCopyInterface.c:184 CCI_initCopyRequest()
>>>>     getFileMetaData() failed: SOAP fault (null)
>>>>      (errno=0, serrno=0)
>>>>     srm client error: CastorSRMCopyInterface.c:184
>>>>     CCI_initCopyRequest() getFileMetaData() failed: SOAP fault (null)
>>>>      (errno=0, serrno=0)
>>>>     java.lang.RuntimeException: CastorSRMCopyInterface.c:184
>>>>     CCI_initCopyRequest() getFileMetaData() failed: SOAP fault (null)
>>>>      (errno=0, serrno=0)
>>>>            at 
>>>> org.dcache.srm.client.SRMClientV1.copy(SRMClientV1.java:780)
>>>>            at
>>>>     gov.fnal.srm.util.SRMCopyClientV1.start(SRMCopyClientV1.java:144)
>>>>            at 
>>>> gov.fnal.srm.util.SRMDispatcher.work(SRMDispatcher.java:779)
>>>>            at 
>>>> gov.fnal.srm.util.SRMDispatcher.main(SRMDispatcher.java:372)
>>>>
>>>>     Any ideas??
>>>>
>>>> BTW is there any other way to transfer those files ..The sample is 
>>>> small and I want to send it
>>>> to CERN and FNAL...
>>>> Thanks
>>>> Mike
>>>>
>>>> ----------
>>>> group: IT
>>>> messages: 14474
>>>> nosy: ajit, bachtis, dan, dasu, rader, radtke, wcmaier
>>>> priority: triage
>>>> status: unread
>>>> title: Moving files with srmcp
>>>>
>>>> ______________________________________
>>>> UW-HEP Help System <help@hep.wisc.edu>
>>>> <https://help.hep.wisc.edu/issue5348>
>>>> ______________________________________
>>>>     
>>>>         
>>> ----------
>>> status: unread -> chatting
>>>
>>> ______________________________________
>>> UW-HEP Help System <help@hep.wisc.edu>
>>> <https://help.hep.wisc.edu/issue5348>
>>> ______________________________________
>>>
>>>       
>
> ______________________________________
> UW-HEP Help System <help@hep.wisc.edu>
> <https://help.hep.wisc.edu/issue5348>
> ______________________________________
>
msg14485 (view) From: ajit To: ajit, bachtis, dan, dasu, rader, radtke, wcmaier Date: 2008.07.09 12:21
Hi Mike,

> Hi Ajit,
> I think I tried from login01
> b) The path exists , I made it :-)

Ok.. then try this :

srmcp -debug=true 
srm://cmssrm.hep.wisc.edu:8443//pnfs/hep.wisc.edu/data5/uscms01/bachtis/ZTT50K-HLT-ZtautauRECO/ZtautauRECO-ZTT50K-HLT-0499.root 
 
srm://srm-cms.cern.ch:8443/srm/managerv2?SFN=/castor/cern.ch/user/b/bachtis/samples/Ztautau-50K-207/file491.root 


and see what kind of error you get (the -debug option should printout a bunch of 
stuff).

> This is not for my jobs,I always use condor.
> I want to move this sample for use by other people that they would like 
> to have it in FNAL or CERN .. Maybe we can do it centrally, I mean can 
> we publish those files to DBS and then phedex them to CERN/FNAL?

These samples could be publised into local DBS. But we don't have a local DBS 
setup at Wisconsin yet. Dan and I are working on it. In order to publish the 
datasets into the local DBS, the FrameworkJobReport files from your jobs (which 
produced these root files) need to be available. Are they ?

Once the root files are registered in our local DBS (when we set it up), then 
they will need to migrated to Global DBS and then only can be xfer'ed via 
PhEDEx. But we are not there yet. So for the time being, you can either copy it 
to CERN/FNAL manually or have the users who want to access the samples in our 
dCache by running condor jobs locally i.e. we can provide them local accounts 
here in our cluster for that.

Thanks,
- Ajit




> Ajit Mohapatra via UW-HEP Help System wrote:
> 
>> Hi Mike,
>>
>> To start with you have got 2 things wrong in your srmcp command (below) :
>>
>> a) CERN srm doesn't support "managerv1", only "managerv2".
>> b) I am not sure that the path /castor/cern.ch/user/b/bachtis/ exists 
>> in CERN Castor ! Is it ?
>>
>>  From which machine you are executing the srmcp command ?
>>
>> Next, why do you want to copy files to CERN from our dCache ? Is there 
>> any problem running your jobs at Wisc ? If so, we should address that 
>> first. As you know, you can submit jobs (to condor) from your desktop 
>> or the login machines here. Also, you can submit CRAB jobs from 
>> anywhere to Wisconsin to run on the samples that we have on our 
>> dCache. If you are having problems with CRAB submissions, then we need 
>> to address that too.
>>
>> Also (as you probably know) we have the FAQ page ( 
>> http://www.hep.wisc.edu/cms/comp/faq.html) available from the "User 
>> Documentation" link from our T2 computing page which contains some 
>> information about accessing/copying files from our dCache. But in your 
>> case, you need to specify the correct path to an (user) area at CERN 
>> Castor if it exits.
>>
>> Thanks,
>> - Ajit
>>
>>
>>  
>>
>>> Dear All,
>>>
>>> I am trying to transfer some files from dcache to CERN and I am doing
>>> srmcp  
>>> srm://cmssrm.hep.wisc.edu:8443//pnfs/hep.wisc.edu/data5/uscms01/bachtis/ZTT50K-HLT-ZtautauRECO/ZtautauRECO-ZTT50K-HLT-0499.root 
>>>    
>>> srm://srm.cern.ch:8443//srm/managerv1?SFN=/castor/cern.ch/user/b/bachtis/samples/Ztautau-50K-207/file491.root 
>>>
>>>
>>>
>>>     I get this error:
>>>
>>>     SRMClientV1 : copy: try # 0 failed with error
>>>     SRMClientV1 : CastorSRMCopyInterface.c:184 CCI_initCopyRequest()
>>>     getFileMetaData() failed: SOAP fault (null)
>>>      (errno=0, serrno=0)
>>>     srm client error: CastorSRMCopyInterface.c:184
>>>     CCI_initCopyRequest() getFileMetaData() failed: SOAP fault (null)
>>>      (errno=0, serrno=0)
>>>     java.lang.RuntimeException: CastorSRMCopyInterface.c:184
>>>     CCI_initCopyRequest() getFileMetaData() failed: SOAP fault (null)
>>>      (errno=0, serrno=0)
>>>            at 
>>> org.dcache.srm.client.SRMClientV1.copy(SRMClientV1.java:780)
>>>            at
>>>     gov.fnal.srm.util.SRMCopyClientV1.start(SRMCopyClientV1.java:144)
>>>            at 
>>> gov.fnal.srm.util.SRMDispatcher.work(SRMDispatcher.java:779)
>>>            at 
>>> gov.fnal.srm.util.SRMDispatcher.main(SRMDispatcher.java:372)
>>>
>>>     Any ideas??
>>>
>>> BTW is there any other way to transfer those files ..The sample is 
>>> small and I want to send it
>>> to CERN and FNAL...
>>> Thanks
>>> Mike
>>>
>>> ----------
>>> group: IT
>>> messages: 14474
>>> nosy: ajit, bachtis, dan, dasu, rader, radtke, wcmaier
>>> priority: triage
>>> status: unread
>>> title: Moving files with srmcp
>>>
>>> ______________________________________
>>> UW-HEP Help System <help@hep.wisc.edu>
>>> <https://help.hep.wisc.edu/issue5348>
>>> ______________________________________
>>>     
>>
>>
>> ----------
>> status: unread -> chatting
>>
>> ______________________________________
>> UW-HEP Help System <help@hep.wisc.edu>
>> <https://help.hep.wisc.edu/issue5348>
>> ______________________________________
>>
msg14484 (view) From: bachtis To: ajit, bachtis, dan, dasu, rader, radtke, wcmaier Date: 2008.07.09 11:38
Hi Ajit,
I think I tried from login01
b) The path exists , I made it :-)

This is not for my jobs,I always use condor.
I want to move this sample for use by other people that they would like 
to have it in FNAL or CERN .. Maybe we can do it centrally, I mean can 
we publish those files to DBS and then phedex them to CERN/FNAL?






Ajit Mohapatra via UW-HEP Help System wrote:
> Hi Mike,
>
> To start with you have got 2 things wrong in your srmcp command (below) :
>
> a) CERN srm doesn't support "managerv1", only "managerv2".
> b) I am not sure that the path /castor/cern.ch/user/b/bachtis/ exists in CERN 
> Castor ! Is it ?
>
>  From which machine you are executing the srmcp command ?
>
> Next, why do you want to copy files to CERN from our dCache ? Is there any 
> problem running your jobs at Wisc ? If so, we should address that first. As you 
> know, you can submit jobs (to condor) from your desktop or the login machines 
> here. Also, you can submit CRAB jobs from anywhere to Wisconsin to run on the 
> samples that we have on our dCache. If you are having problems with CRAB 
> submissions, then we need to address that too.
>
> Also (as you probably know) we have the FAQ page ( 
> http://www.hep.wisc.edu/cms/comp/faq.html) available from the "User 
> Documentation" link from our T2 computing page which contains some information 
> about accessing/copying files from our dCache. But in your case, you need to 
> specify the correct path to an (user) area at CERN Castor if it exits.
>
> Thanks,
> - Ajit
>
>
>   
>> Dear All,
>>
>> I am trying to transfer some files from dcache to CERN and I am doing
>> srmcp  
>> srm://cmssrm.hep.wisc.edu:8443//pnfs/hep.wisc.edu/data5/uscms01/bachtis/ZTT50K-HLT-ZtautauRECO/ZtautauRECO-ZTT50K-HLT-0499.root 
>>    
>> srm://srm.cern.ch:8443//srm/managerv1?SFN=/castor/cern.ch/user/b/bachtis/samples/Ztautau-50K-207/file491.root 
>>
>>
>>
>>     I get this error:
>>
>>     SRMClientV1 : copy: try # 0 failed with error
>>     SRMClientV1 : CastorSRMCopyInterface.c:184 CCI_initCopyRequest()
>>     getFileMetaData() failed: SOAP fault (null)
>>      (errno=0, serrno=0)
>>     srm client error: CastorSRMCopyInterface.c:184
>>     CCI_initCopyRequest() getFileMetaData() failed: SOAP fault (null)
>>      (errno=0, serrno=0)
>>     java.lang.RuntimeException: CastorSRMCopyInterface.c:184
>>     CCI_initCopyRequest() getFileMetaData() failed: SOAP fault (null)
>>      (errno=0, serrno=0)
>>            at org.dcache.srm.client.SRMClientV1.copy(SRMClientV1.java:780)
>>            at
>>     gov.fnal.srm.util.SRMCopyClientV1.start(SRMCopyClientV1.java:144)
>>            at gov.fnal.srm.util.SRMDispatcher.work(SRMDispatcher.java:779)
>>            at gov.fnal.srm.util.SRMDispatcher.main(SRMDispatcher.java:372)
>>
>>     Any ideas??
>>
>> BTW is there any other way to transfer those files ..The sample is small 
>> and I want to send it
>> to CERN and FNAL...
>> Thanks
>> Mike
>>
>> ----------
>> group: IT
>> messages: 14474
>> nosy: ajit, bachtis, dan, dasu, rader, radtke, wcmaier
>> priority: triage
>> status: unread
>> title: Moving files with srmcp
>>
>> ______________________________________
>> UW-HEP Help System <help@hep.wisc.edu>
>> <https://help.hep.wisc.edu/issue5348>
>> ______________________________________
>>     
>
> ----------
> status: unread -> chatting
>
> ______________________________________
> UW-HEP Help System <help@hep.wisc.edu>
> <https://help.hep.wisc.edu/issue5348>
> ______________________________________
>
msg14483 (view) From: ajit To: ajit, bachtis, dan, dasu, rader, radtke, wcmaier Date: 2008.07.09 11:22
Hi Mike,

To start with you have got 2 things wrong in your srmcp command (below) :

a) CERN srm doesn't support "managerv1", only "managerv2".
b) I am not sure that the path /castor/cern.ch/user/b/bachtis/ exists in CERN 
Castor ! Is it ?

 From which machine you are executing the srmcp command ?

Next, why do you want to copy files to CERN from our dCache ? Is there any 
problem running your jobs at Wisc ? If so, we should address that first. As you 
know, you can submit jobs (to condor) from your desktop or the login machines 
here. Also, you can submit CRAB jobs from anywhere to Wisconsin to run on the 
samples that we have on our dCache. If you are having problems with CRAB 
submissions, then we need to address that too.

Also (as you probably know) we have the FAQ page ( 
http://www.hep.wisc.edu/cms/comp/faq.html) available from the "User 
Documentation" link from our T2 computing page which contains some information 
about accessing/copying files from our dCache. But in your case, you need to 
specify the correct path to an (user) area at CERN Castor if it exits.

Thanks,
- Ajit


> Dear All,
> 
> I am trying to transfer some files from dcache to CERN and I am doing
> srmcp  
> srm://cmssrm.hep.wisc.edu:8443//pnfs/hep.wisc.edu/data5/uscms01/bachtis/ZTT50K-HLT-ZtautauRECO/ZtautauRECO-ZTT50K-HLT-0499.root 
>    
> srm://srm.cern.ch:8443//srm/managerv1?SFN=/castor/cern.ch/user/b/bachtis/samples/Ztautau-50K-207/file491.root 
> 
> 
> 
>     I get this error:
> 
>     SRMClientV1 : copy: try # 0 failed with error
>     SRMClientV1 : CastorSRMCopyInterface.c:184 CCI_initCopyRequest()
>     getFileMetaData() failed: SOAP fault (null)
>      (errno=0, serrno=0)
>     srm client error: CastorSRMCopyInterface.c:184
>     CCI_initCopyRequest() getFileMetaData() failed: SOAP fault (null)
>      (errno=0, serrno=0)
>     java.lang.RuntimeException: CastorSRMCopyInterface.c:184
>     CCI_initCopyRequest() getFileMetaData() failed: SOAP fault (null)
>      (errno=0, serrno=0)
>            at org.dcache.srm.client.SRMClientV1.copy(SRMClientV1.java:780)
>            at
>     gov.fnal.srm.util.SRMCopyClientV1.start(SRMCopyClientV1.java:144)
>            at gov.fnal.srm.util.SRMDispatcher.work(SRMDispatcher.java:779)
>            at gov.fnal.srm.util.SRMDispatcher.main(SRMDispatcher.java:372)
> 
>     Any ideas??
> 
> BTW is there any other way to transfer those files ..The sample is small 
> and I want to send it
> to CERN and FNAL...
> Thanks
> Mike
> 
> ----------
> group: IT
> messages: 14474
> nosy: ajit, bachtis, dan, dasu, rader, radtke, wcmaier
> priority: triage
> status: unread
> title: Moving files with srmcp
> 
> ______________________________________
> UW-HEP Help System <help@hep.wisc.edu>
> <https://help.hep.wisc.edu/issue5348>
> ______________________________________
msg14474 (view) From: bachtis To: ajit, bachtis, dan, dasu, rader, radtke, wcmaier Date: 2008.07.09 05:26
Dear All,

I am trying to transfer some files from dcache to CERN and I am doing
srmcp  
srm://cmssrm.hep.wisc.edu:8443//pnfs/hep.wisc.edu/data5/uscms01/bachtis/ZTT50K-HLT-ZtautauRECO/ZtautauRECO-ZTT50K-HLT-0499.root 
   
srm://srm.cern.ch:8443//srm/managerv1?SFN=/castor/cern.ch/user/b/bachtis/samples/Ztautau-50K-207/file491.root 



    I get this error:

    SRMClientV1 : copy: try # 0 failed with error
    SRMClientV1 : CastorSRMCopyInterface.c:184 CCI_initCopyRequest()
    getFileMetaData() failed: SOAP fault (null)
     (errno=0, serrno=0)
    srm client error: CastorSRMCopyInterface.c:184
    CCI_initCopyRequest() getFileMetaData() failed: SOAP fault (null)
     (errno=0, serrno=0)
    java.lang.RuntimeException: CastorSRMCopyInterface.c:184
    CCI_initCopyRequest() getFileMetaData() failed: SOAP fault (null)
     (errno=0, serrno=0)
           at org.dcache.srm.client.SRMClientV1.copy(SRMClientV1.java:780)
           at
    gov.fnal.srm.util.SRMCopyClientV1.start(SRMCopyClientV1.java:144)
           at gov.fnal.srm.util.SRMDispatcher.work(SRMDispatcher.java:779)
           at gov.fnal.srm.util.SRMDispatcher.main(SRMDispatcher.java:372)

    Any ideas??

BTW is there any other way to transfer those files ..The sample is small 
and I want to send it
to CERN and FNAL...
Thanks
Mike
History
Date User Action Args
2008-08-04 08:32:48wcmaiersetstatus: chatting -> resolved
2008-07-23 12:27:22dansetmessages: + msg14563
2008-07-23 09:21:16ajitsetmessages: + msg14556
2008-07-22 03:55:51bachtissetmessages: + msg14544
2008-07-11 07:55:23wcmaiersetpriority: triage -> normal
topic: + dCache, CMS
assignedto: ajit
2008-07-09 12:21:49ajitsetmessages: + msg14485
2008-07-09 11:38:57bachtissetmessages: + msg14484
2008-07-09 11:22:44ajitsetstatus: unread -> chatting
messages: + msg14483
2008-07-09 05:26:53bachtiscreate