Hi Neng-

On Wed, Jun 18, 2008 at 11:14:49AM +0200, Neng Xu wrote:
> Yesterday when we install a ATLAS release (about 5GB) on
> /afs/hep.wisc.edu/atlas/osg/atlas_app directory, the machine
> crashed and in the /var/log/message I found many error like this:

Since this is a crash on your AFS client, I can't help much. I
don't have access to higgs08 and it's not part of our HEP cluster --
you'll probably need to contact a CS admin.

> Jun 17 18:03:22 higgs08 kernel: post_create:  no inode, dir (dev=afs, 
> ino=297336621)
> Jun 17 18:03:24 higgs08 last message repeated 30 times
> Jun 17 18:03:24 higgs08 kernel: post_create:  no inode, dir (dev=afs, 
> ino=297336619)
> Jun 17 18:03:24 higgs08 last message repeated 2 times
> Jun 17 18:03:24 higgs08 kernel: post_create:  no inode, dir (dev=afs, 
> ino=297336617)
> Jun 17 18:03:25 higgs08 kernel: post_create:  no inode, dir (dev=afs, 
> ino=297336617)
> Jun 17 18:03:25 higgs08 kernel: post_create:  no inode, dir (dev=afs, 
> ino=297336615)
> Jun 17 18:03:26 higgs08 last message repeated 21 times
>
> Could you please check what is this problem? 

At 18:24 on 17 June (20 minutes after your crash), our server logged
that it couldn't reach your client. I don't see any other
information on our side.

> I check the quota and it seems to be ok:
>
> [higgs08] /afs/hep.wisc.edu/atlas/osg/atlas_app/atlas_rel > fs listquota
> Volume Name                   Quota      Used %Used   Partition
> nb.atlas.osg              104857600  67148956   64%         22%

Jup; quota looks good. I'd be very surprised, though, if a quota
problem led to a system crash.

At this point, you should probably consider upgrading the AFS client
to a more recent release of OpenAFS (if one's available). Can you
reproduce this problem on another host?

-- 

o--------------------------{ Will Maier }--------------------------o
| jabber:...wcmaier@xmpp.lfod.us | email:..will.maier@hep.wisc.edu |
| office:...........608.263.9692 | cell:..............608.438.6162 |
*--------------------[ UW High Energy Physics ]--------------------*

Hi Will,

Yesterday when we install a ATLAS release (about 5GB) on 
/afs/hep.wisc.edu/atlas/osg/atlas_app directory, the machine crashed and 
in the /var/log/message I found many error like this:

Jun 17 18:03:22 higgs08 kernel: post_create:  no inode, dir (dev=afs, 
ino=297336621)
Jun 17 18:03:24 higgs08 last message repeated 30 times
Jun 17 18:03:24 higgs08 kernel: post_create:  no inode, dir (dev=afs, 
ino=297336619)
Jun 17 18:03:24 higgs08 last message repeated 2 times
Jun 17 18:03:24 higgs08 kernel: post_create:  no inode, dir (dev=afs, 
ino=297336617)
Jun 17 18:03:25 higgs08 kernel: post_create:  no inode, dir (dev=afs, 
ino=297336617)
Jun 17 18:03:25 higgs08 kernel: post_create:  no inode, dir (dev=afs, 
ino=297336615)
Jun 17 18:03:26 higgs08 last message repeated 21 times

Could you please check what is this problem? I check the quota and it 
seems to be ok:

[higgs08] /afs/hep.wisc.edu/atlas/osg/atlas_app/atlas_rel > fs listquota
Volume Name                   Quota      Used %Used   Partition
nb.atlas.osg              104857600  67148956   64%         22%

This is really urgent, please help!

Thanks,
Neng

On Tue, Apr 22, 2008 at 09:22:09PM +0200, Sridhara Dasu wrote:
> You can allow write access to higgs08 there.  You don't need
> to ask Will to do it:
>
> fs setacl -dir /afs/hep.wisc.edu/atlas/osg/atlas_app -acl atlassoft rlidwka

Note that this needs to be executed recursively (assuming you want
directories further down the tree to have similar ACLs):

    $ find /afs/hep.wisc.edu/atlas/osg/atlas_app -type d -print0 |\
        xargs -r0 -i__dir__ -n1 fs sa __dir__ atlassoft rlidwka

-- 

o--------------------------{ Will Maier }--------------------------o
| jabber:...wcmaier@xmpp.lfod.us | email:..will.maier@hep.wisc.edu |
| office:...........608.263.9692 | cell:..............608.438.6162 |
*--------------------[ UW High Energy Physics ]--------------------*

Hi Sridhara,

Thanks! I will try now.

Neng

Sridhara Dasu wrote:
> Neng,
>
> The whole purpose of IP based permission is to avoid tokens
> that are user based. Any process on to higgs08 should be
> able to write to /afs/hep.wisc.edu/atlas/software.  There
> is no need to make any changes.
>
> Since you have full access to /afs/hep.wisc.edu/atlas/osg/atlas_app
>
> You can allow write access to higgs08 there.  You don't need
> to ask Will to do it:
>
> fs setacl -dir /afs/hep.wisc.edu/atlas/osg/atlas_app -acl atlassoft 
> rlidwka
>
> will give write access there.
>
> I recommend that you test your installation from higgs08, without
> getting any tokens -- since you get in tokens at login, do an unlog
> before running installation.
>
> Sridhara
>
> ---------------------------------------------------------------------
> Prof. Sridhara Rao Dasu                         Department of Physics
> dasu@hep.wisc.edu                             University of Wisconsin
> http://www.hep.wisc.edu/~dasu                    4289 Chamberlin Hall
> 608-262-3678 ( Office )                        1150 University Avenue
> 408-829-6625 (Wireless)                        Madison, WI 53706, USA
>
>
> On Apr 22, 2008, at 9:05 PM, Neng Xu wrote:
>
>> Hi Will,
>>
>> Thanks a lot for the help but we need to change something here. On 
>> higgs08, the grid user is mapped to usatlas2. The directory we need 
>> to use is
>>
>> /afs/hep.wisc.edu/atlas/osg/atlas_app/
>>
>> Could you please give usatlas2 the permission to this directory and 
>> all its subdirectories?
>>
>> Thank,
>>
>> Neng
>>
>> Will Maier via UW-HEP Help System wrote:
>>> Hi Neng-
>>>
>>> On Sun, Apr 13, 2008 at 04:57:21PM +0200, Neng Xu wrote:
>>>
>>>> This approach is very good. We will use higgs08 for installation.
>>>> Could you please setup the permission on it?
>>>>
>>>
>>> Sorry for the delay; I've been out of the office since the middle of
>>> last week. I conferred with Dan Bradley this morning, and he agrees
>>> that this is the best approach. I've created an AFS group
>>> ('atlassoft') and added higgs08's IP address (128.105.244.171) to
>>> this group. I also gave atlassoft permissions on the following
>>> directory and all of its children:
>>>        /afs/hep.wisc.edu/atlas/software
>>>
>>> If atlassoft needs access to other parts of the ATLAS AFS space, I
>>> can take care of that, too.
>>>
>>> Thanks!
>>>
>>>
>

Neng,

The whole purpose of IP based permission is to avoid tokens
that are user based. Any process on to higgs08 should be
able to write to /afs/hep.wisc.edu/atlas/software.  There
is no need to make any changes.

Since you have full access to /afs/hep.wisc.edu/atlas/osg/atlas_app

You can allow write access to higgs08 there.  You don't need
to ask Will to do it:

fs setacl -dir /afs/hep.wisc.edu/atlas/osg/atlas_app -acl atlassoft  
rlidwka

will give write access there.

I recommend that you test your installation from higgs08, without
getting any tokens -- since you get in tokens at login, do an unlog
before running installation.

Sridhara

---------------------------------------------------------------------
Prof. Sridhara Rao Dasu                         Department of Physics
dasu@hep.wisc.edu                             University of Wisconsin
http://www.hep.wisc.edu/~dasu                    4289 Chamberlin Hall
608-262-3678 ( Office )                        1150 University Avenue
408-829-6625 (Wireless)                        Madison, WI 53706, USA


On Apr 22, 2008, at 9:05 PM, Neng Xu wrote:

> Hi Will,
>
> Thanks a lot for the help but we need to change something here. On  
> higgs08, the grid user is mapped to usatlas2. The directory we need  
> to use is
>
> /afs/hep.wisc.edu/atlas/osg/atlas_app/
>
> Could you please give usatlas2 the permission to this directory and  
> all its subdirectories?
>
> Thank,
>
> Neng
>
> Will Maier via UW-HEP Help System wrote:
>> Hi Neng-
>>
>> On Sun, Apr 13, 2008 at 04:57:21PM +0200, Neng Xu wrote:
>>
>>> This approach is very good. We will use higgs08 for installation.
>>> Could you please setup the permission on it?
>>>
>>
>> Sorry for the delay; I've been out of the office since the middle of
>> last week. I conferred with Dan Bradley this morning, and he agrees
>> that this is the best approach. I've created an AFS group
>> ('atlassoft') and added higgs08's IP address (128.105.244.171) to
>> this group. I also gave atlassoft permissions on the following
>> directory and all of its children:
>>        /afs/hep.wisc.edu/atlas/software
>>
>> If atlassoft needs access to other parts of the ATLAS AFS space, I
>> can take care of that, too.
>>
>> Thanks!
>>
>>

Hi Will,

Thanks a lot for the help but we need to change something here. On 
higgs08, the grid user is mapped to usatlas2. The directory we need to 
use is

/afs/hep.wisc.edu/atlas/osg/atlas_app/

Could you please give usatlas2 the permission to this directory and all 
its subdirectories?

Thank,

Neng

Will Maier via UW-HEP Help System wrote:
> Hi Neng-
>
> On Sun, Apr 13, 2008 at 04:57:21PM +0200, Neng Xu wrote:
>   
>> This approach is very good. We will use higgs08 for installation.
>> Could you please setup the permission on it?
>>     
>
> Sorry for the delay; I've been out of the office since the middle of
> last week. I conferred with Dan Bradley this morning, and he agrees
> that this is the best approach. I've created an AFS group
> ('atlassoft') and added higgs08's IP address (128.105.244.171) to
> this group. I also gave atlassoft permissions on the following
> directory and all of its children:
>     
>     /afs/hep.wisc.edu/atlas/software
>
> If atlassoft needs access to other parts of the ATLAS AFS space, I
> can take care of that, too.
>
> Thanks!
>
>

Hi Neng-

On Sun, Apr 13, 2008 at 04:57:21PM +0200, Neng Xu wrote:
> This approach is very good. We will use higgs08 for installation.
> Could you please setup the permission on it?

Sorry for the delay; I've been out of the office since the middle of
last week. I conferred with Dan Bradley this morning, and he agrees
that this is the best approach. I've created an AFS group
('atlassoft') and added higgs08's IP address (128.105.244.171) to
this group. I also gave atlassoft permissions on the following
directory and all of its children:
    
    /afs/hep.wisc.edu/atlas/software

If atlassoft needs access to other parts of the ATLAS AFS space, I
can take care of that, too.

Thanks!

-- 

o--------------------------{ Will Maier }--------------------------o
| jabber:...wcmaier@xmpp.lfod.us | email:..will.maier@hep.wisc.edu |
| office:...........608.263.9692 | cell:..............608.438.6162 |
*--------------------[ UW High Energy Physics ]--------------------*

Hi Will,

This approach is very good. We will use higgs08 for installation. Could 
you please setup the permission on it?

Thanks,

Neng

Will Maier via UW-HEP Help System wrote:
> Hi Sridhara and Annabelle-
>
> On Sun, Apr 13, 2008 at 03:10:39PM +0200, Sridhara Dasu wrote:
>   
>> I understand from Sau Lan that you would like automatic
>> installations from BNL of your software.  For automatic
>> installation one would be using grid tools, which work in AFS
>> without tokens from what I know using host based authentication.
>> You shouldn't run into token loss problem that you are hitting.
>> Dan (who is currently on vacation) or Will can confirm.
>>     
>
> That is correct. For the automatic CMSSW installations, we route the
> jobs to special machines that are given a IP-based ACL in AFS. Token
> corruption should not adversely affect this installation method.
> Since the IP ACL allows _any_ process on the installation machine to
> write into a given AFS area, we do not allow other (non-CMSSW
> installation) Condor jobs to run on these hosts.
>
> If this is the approach you'd like to take, we'll need to identify
> one or two dedicated machines for ATLAS installation.
>
> Thanks!
>
>

Hi Sridhara and Annabelle-

On Sun, Apr 13, 2008 at 03:10:39PM +0200, Sridhara Dasu wrote:
> I understand from Sau Lan that you would like automatic
> installations from BNL of your software.  For automatic
> installation one would be using grid tools, which work in AFS
> without tokens from what I know using host based authentication.
> You shouldn't run into token loss problem that you are hitting.
> Dan (who is currently on vacation) or Will can confirm.

That is correct. For the automatic CMSSW installations, we route the
jobs to special machines that are given a IP-based ACL in AFS. Token
corruption should not adversely affect this installation method.
Since the IP ACL allows _any_ process on the installation machine to
write into a given AFS area, we do not allow other (non-CMSSW
installation) Condor jobs to run on these hosts.

If this is the approach you'd like to take, we'll need to identify
one or two dedicated machines for ATLAS installation.

Thanks!

-- 

o--------------------------{ Will Maier }--------------------------o
| jabber:...wcmaier@xmpp.lfod.us | email:..will.maier@hep.wisc.edu |
| office:...........608.263.9692 | cell:..............608.438.6162 |
*--------------------[ UW High Energy Physics ]--------------------*

Dear Annabelle,

Here's another thought.  Perhaps, you can temporarily allow
system:anyuser to write to your directory, install the software
and then put the restrictions back again.  If system:anyuser
has write access token loss does not prevent writing.  Please
try the following:

mkdir <your AFS installation directory>
cd <your AFS installation directory>
fs setacl -dir . -setacl system:anyuser rlidwka
<Your installation instructions>
(verify you still have tokens, if not get them)
fs setacl -dir . -setacl system:anyuser rl

I understand from Sau Lan that you would like automatic installations
from BNL of your software.  For automatic installation one would
be using grid tools, which work in AFS without tokens from what I
know using host based authentication.  You shouldn't run into token
loss problem that you are hitting.  Dan (who is currently on vacation)
or Will can confirm.

Sridhara

---------------------------------------------------------------------
Prof. Sridhara Rao Dasu                         Department of Physics
dasu@hep.wisc.edu                             University of Wisconsin
http://www.hep.wisc.edu/~dasu                    4289 Chamberlin Hall
608-262-3678 ( Office )                        1150 University Avenue
408-829-6625 (Wireless)                        Madison, WI 53706, USA


On Apr 5, 2008, at 1:15 PM, Annabelle Leung wrote:
> Ok great! Thanks!!
>
> On Fri, Apr 4, 2008 at 10:19 PM, <rader@hep.wisc.edu> wrote:
>
> Annabelle,
>
> I've done what Dan has described for you.  Please try:
>
>  /afs/hep.wisc.edu/atlas/osg/atlas_app/atlas_rel/13.2.0.NEW/
>
> Here's the full recipe:
>
>  ssh login.hep.wisc.edu
>  cd /scratch
>  mkdir 13.x.y
>  cd 13.x.y
>  install AtlasProduction
>  SRC=/scratch/13.x.y
>  DST=/afs/hep.wisc.edu/atlas/osg/atlas_app/atlas_rel/13.x.y
>  find . -type f | xargs grep -l $SRC |
>   xargs --max-args=1 --replace=FILE sh -c \
>  "sed \"s|$SRC|$DST|\" < FILE > FILE.new && mv -f FILE.new FILE"
>  mkdir /afs/hep.wisc.edu/atlas/osg/atlas_app/atlas_rel/13.x.y
>  cp -R -p . $DST
>  rm -rf $SRC
>
> steve

Annabelle,

I've done what Dan has described for you.  Please try:
 
  /afs/hep.wisc.edu/atlas/osg/atlas_app/atlas_rel/13.2.0.NEW/

Here's the full recipe:

 ssh login.hep.wisc.edu
 cd /scratch
 mkdir 13.x.y
 cd 13.x.y
 install AtlasProduction
 SRC=/scratch/13.x.y
 DST=/afs/hep.wisc.edu/atlas/osg/atlas_app/atlas_rel/13.x.y
 find . -type f | xargs grep -l $SRC |
   xargs --max-args=1 --replace=FILE sh -c \ 
  "sed \"s|$SRC|$DST|\" < FILE > FILE.new && mv -f FILE.new FILE"
 mkdir /afs/hep.wisc.edu/atlas/osg/atlas_app/atlas_rel/13.x.y
 cp -R -p . $DST
 rm -rf $SRC

steve
--

 > ---- Original Message ----
 > From: Dan Bradley <dan@hep.wisc.edu>
 > Annabelle,
 > 
 > Here is an example of a command that we use for CMS in a case where we 
 > need to move a pacman installation (for completely different reasons).  
 > In this particular case, we are replacing the path 
 > /osg/wnclient_vols/wnclient0.6.0 with the path 
 > /osg/wnclient_vols/wnclient0.6.0/osg/wnclient.
 > 
 > find . -type f | xargs grep -l /osg/wnclient_vols/wnclient0.6.0 |
 > xargs --max-args=1 --replace=FILE sh -c \
 > 'sed "s|/osg/wnclient_vols/wnclient0.6.0|/osg/wnclient|g" < FILE > 
 > FILE.new && mv FILE.new FILE'
 > 
 > --Dan
 > 
 > Annabelle Leung Fook Cheong wrote:
 > > Hi Steve, 
 > >
 > > I am still getting the same problem again. I cannot follow the same procedure as you did below as I am not sure whether the insta
 > llation is correct that way since you install the software in /scratch and then move it to /afs/hep.wisc.edu.. i dont think this wo
 > uld work as it doesn't have the same path as installed.
 > > So I logged on to login.hep.wisc.edu, and installed directly  in  /afs/hep.wisc.edu/atlas/osg/atlas_app/atlas_rel/13.2.0, after l
 > ess than an hour, the permissions have changed and I cannot write anymore
 > >
 > > I will try to install from higgs08 now but I doubt this would work. 
 > > Have you been able to install directly on /afs/?
 > >
 > > Thanks
 > > Annabelle
 > >
 > > ________________________________
 > >
 > > From: Steve Rader via UW-HEP Help System [mailto:help@hep.wisc.edu]
 > > Sent: Tue 4/1/2008 3:09 AM
 > > To: Annabelle Leung Fook Cheong; Bruce Mellado Garcia; ajit@hep.wisc.edu; dan@hep.wisc.edu; Sridhara Dasu; rader@ginseng.hep.wisc
 > .edu; radtke@physics.wisc.edu; wcmaier@hep.wisc.edu; Sau Lan Wu
 > > Subject: [issue5166] permissions problems on afs again
 > >
 > >
 > >
 > >
 > > Neng & Mengmeng:
 > >
 > > There should be a good installation of AtlasProduction 13.2.0 in
 > > /afs/hep.wisc.edu/atlas/osg/atlas_app/atlas_rel/13.2.0. 
 > >
 > > In the future, please try something like this:
 > >
 > >  ssh login.hep.wisc.edu
 > >  cd /scratch
 > >  mkdir 13.x.y
 > >  cd 13.x.y
 > >  install AtlasProduction
 > >  mkdir /afs/hep.wisc.edu/atlas/osg/atlas_app/atlas_rel/13.x.y
 > >  cp -R -p . /afs/hep.wisc.edu/atlas/osg/atlas_app/atlas_rel/13.x.y/
 > >  rm -rf /scratch/13.x.y
 > >
 > > Let me know if you more help.
 > >
 > > steve
 > > --
 > >
 > >  > ---- Original Message ----
 > >  > From: Steve Rader via UW-HEP Help System <help@hep.wisc.edu>
 > >  >
 > >  > I just spoke with Mengeng Chen <mchen@cs.wisc.edu> on the
 > >  > phone.  He reports that even just...
 > >  >
 > >  >  cp -R <localdisk> /afs/hep/atlas/...
 > >  >
 > >  > mysteriously fails on higgs06.cs.wisc.edu (or maybe some other
 > >  > higgsXX.cs.wisc.edu host) despite having a valid AFS token!
 > >  >
 > >  > I was able to install AtlasProduction 13.2.0 in /afs/hep/home/radert
 > >  > on Friday.   I'm trying to replicate Mengeng's problem now and will
 > >  > report back later today.
 > >  >
 > >  > steve
 > >  > --
 > >  >
 > >  > ______________________________________
 > >  > UW-HEP Help System <help@hep.wisc.edu>
 > >  > <https://help.hep.wisc.edu/issue5166>
 > >  > ______________________________________
 > >
 > > ----------
 > > status: chatting -> resolved
 > >
 > > ______________________________________
 > > UW-HEP Help System <help@hep.wisc.edu>
 > > <https://help.hep.wisc.edu/issue5166>
 > > ______________________________________
 > >
 > >
 > >

Correction:

In this example, we are replacing the path 
/osg/wnclient_vols/wnclient0.6.0 with /osg/wnclient.

Note that after you make this change, pacman will not be happy if you 
try to run it in the new location.  Therefore, this technique is only 
useful for write-once repositories.  There may be a way to fix up the 
repository at the new location so that pacman can still work.

--Dan

Dan Bradley via UW-HEP Help System wrote:
> Annabelle,
>
> Here is an example of a command that we use for CMS in a case where we 
> need to move a pacman installation (for completely different reasons).  
> In this particular case, we are replacing the path 
> /osg/wnclient_vols/wnclient0.6.0 with the path 
> /osg/wnclient_vols/wnclient0.6.0/osg/wnclient.
>
> find . -type f | xargs grep -l /osg/wnclient_vols/wnclient0.6.0 |
> xargs --max-args=1 --replace=FILE sh -c \
> 'sed "s|/osg/wnclient_vols/wnclient0.6.0|/osg/wnclient|g" < FILE > 
> FILE.new && mv FILE.new FILE'
>
> --Dan
>
> Annabelle Leung Fook Cheong wrote:
>   
>> Hi Steve, 
>>
>> I am still getting the same problem again. I cannot follow the same procedure as you did below as I am not sure whether the installation is correct that way since you install the software in /scratch and then move it to /afs/hep.wisc.edu.. i dont think this would work as it doesn't have the same path as installed.
>> So I logged on to login.hep.wisc.edu, and installed directly  in  /afs/hep.wisc.edu/atlas/osg/atlas_app/atlas_rel/13.2.0, after less than an hour, the permissions have changed and I cannot write anymore
>>
>> I will try to install from higgs08 now but I doubt this would work. 
>> Have you been able to install directly on /afs/?
>>
>> Thanks
>> Annabelle
>>
>> ________________________________
>>
>> From: Steve Rader via UW-HEP Help System [mailto:help@hep.wisc.edu]
>> Sent: Tue 4/1/2008 3:09 AM
>> To: Annabelle Leung Fook Cheong; Bruce Mellado Garcia; ajit@hep.wisc.edu; dan@hep.wisc.edu; Sridhara Dasu; rader@ginseng.hep.wisc.edu; radtke@physics.wisc.edu; wcmaier@hep.wisc.edu; Sau Lan Wu
>> Subject: [issue5166] permissions problems on afs again
>>
>>
>>
>>
>> Neng & Mengmeng:
>>
>> There should be a good installation of AtlasProduction 13.2.0 in
>> /afs/hep.wisc.edu/atlas/osg/atlas_app/atlas_rel/13.2.0. 
>>
>> In the future, please try something like this:
>>
>>  ssh login.hep.wisc.edu
>>  cd /scratch
>>  mkdir 13.x.y
>>  cd 13.x.y
>>  install AtlasProduction
>>  mkdir /afs/hep.wisc.edu/atlas/osg/atlas_app/atlas_rel/13.x.y
>>  cp -R -p . /afs/hep.wisc.edu/atlas/osg/atlas_app/atlas_rel/13.x.y/
>>  rm -rf /scratch/13.x.y
>>
>> Let me know if you more help.
>>
>> steve
>> --
>>
>>  > ---- Original Message ----
>>  > From: Steve Rader via UW-HEP Help System <help@hep.wisc.edu>
>>  >
>>  > I just spoke with Mengeng Chen <mchen@cs.wisc.edu> on the
>>  > phone.  He reports that even just...
>>  >
>>  >  cp -R <localdisk> /afs/hep/atlas/...
>>  >
>>  > mysteriously fails on higgs06.cs.wisc.edu (or maybe some other
>>  > higgsXX.cs.wisc.edu host) despite having a valid AFS token!
>>  >
>>  > I was able to install AtlasProduction 13.2.0 in /afs/hep/home/radert
>>  > on Friday.   I'm trying to replicate Mengeng's problem now and will
>>  > report back later today.
>>  >
>>  > steve
>>  > --
>>  >
>>  > ______________________________________
>>  > UW-HEP Help System <help@hep.wisc.edu>
>>  > <https://help.hep.wisc.edu/issue5166>
>>  > ______________________________________
>>
>> ----------
>> status: chatting -> resolved
>>
>> ______________________________________
>> UW-HEP Help System <help@hep.wisc.edu>
>> <https://help.hep.wisc.edu/issue5166>
>> ______________________________________
>>
>>
>>
>>     
>
> ______________________________________
> UW-HEP Help System <help@hep.wisc.edu>
> <https://help.hep.wisc.edu/issue5166>
> ______________________________________
>

Annabelle,

Here is an example of a command that we use for CMS in a case where we 
need to move a pacman installation (for completely different reasons).  
In this particular case, we are replacing the path 
/osg/wnclient_vols/wnclient0.6.0 with the path 
/osg/wnclient_vols/wnclient0.6.0/osg/wnclient.

find . -type f | xargs grep -l /osg/wnclient_vols/wnclient0.6.0 |
xargs --max-args=1 --replace=FILE sh -c \
'sed "s|/osg/wnclient_vols/wnclient0.6.0|/osg/wnclient|g" < FILE > 
FILE.new && mv FILE.new FILE'

--Dan

Annabelle Leung Fook Cheong wrote:
> Hi Steve, 
>
> I am still getting the same problem again. I cannot follow the same procedure as you did below as I am not sure whether the installation is correct that way since you install the software in /scratch and then move it to /afs/hep.wisc.edu.. i dont think this would work as it doesn't have the same path as installed.
> So I logged on to login.hep.wisc.edu, and installed directly  in  /afs/hep.wisc.edu/atlas/osg/atlas_app/atlas_rel/13.2.0, after less than an hour, the permissions have changed and I cannot write anymore
>
> I will try to install from higgs08 now but I doubt this would work. 
> Have you been able to install directly on /afs/?
>
> Thanks
> Annabelle
>
> ________________________________
>
> From: Steve Rader via UW-HEP Help System [mailto:help@hep.wisc.edu]
> Sent: Tue 4/1/2008 3:09 AM
> To: Annabelle Leung Fook Cheong; Bruce Mellado Garcia; ajit@hep.wisc.edu; dan@hep.wisc.edu; Sridhara Dasu; rader@ginseng.hep.wisc.edu; radtke@physics.wisc.edu; wcmaier@hep.wisc.edu; Sau Lan Wu
> Subject: [issue5166] permissions problems on afs again
>
>
>
>
> Neng & Mengmeng:
>
> There should be a good installation of AtlasProduction 13.2.0 in
> /afs/hep.wisc.edu/atlas/osg/atlas_app/atlas_rel/13.2.0. 
>
> In the future, please try something like this:
>
>  ssh login.hep.wisc.edu
>  cd /scratch
>  mkdir 13.x.y
>  cd 13.x.y
>  install AtlasProduction
>  mkdir /afs/hep.wisc.edu/atlas/osg/atlas_app/atlas_rel/13.x.y
>  cp -R -p . /afs/hep.wisc.edu/atlas/osg/atlas_app/atlas_rel/13.x.y/
>  rm -rf /scratch/13.x.y
>
> Let me know if you more help.
>
> steve
> --
>
>  > ---- Original Message ----
>  > From: Steve Rader via UW-HEP Help System <help@hep.wisc.edu>
>  >
>  > I just spoke with Mengeng Chen <mchen@cs.wisc.edu> on the
>  > phone.  He reports that even just...
>  >
>  >  cp -R <localdisk> /afs/hep/atlas/...
>  >
>  > mysteriously fails on higgs06.cs.wisc.edu (or maybe some other
>  > higgsXX.cs.wisc.edu host) despite having a valid AFS token!
>  >
>  > I was able to install AtlasProduction 13.2.0 in /afs/hep/home/radert
>  > on Friday.   I'm trying to replicate Mengeng's problem now and will
>  > report back later today.
>  >
>  > steve
>  > --
>  >
>  > ______________________________________
>  > UW-HEP Help System <help@hep.wisc.edu>
>  > <https://help.hep.wisc.edu/issue5166>
>  > ______________________________________
>
> ----------
> status: chatting -> resolved
>
> ______________________________________
> UW-HEP Help System <help@hep.wisc.edu>
> <https://help.hep.wisc.edu/issue5166>
> ______________________________________
>
>
>

Hi Steve, 

I am still getting the same problem again. I cannot follow the same procedure as you did below as I am not sure whether the installation is correct that way since you install the software in /scratch and then move it to /afs/hep.wisc.edu.. i dont think this would work as it doesn't have the same path as installed.
So I logged on to login.hep.wisc.edu, and installed directly  in  /afs/hep.wisc.edu/atlas/osg/atlas_app/atlas_rel/13.2.0, after less than an hour, the permissions have changed and I cannot write anymore

I will try to install from higgs08 now but I doubt this would work. 
Have you been able to install directly on /afs/?

Thanks
Annabelle

________________________________

From: Steve Rader via UW-HEP Help System [mailto:help@hep.wisc.edu]
Sent: Tue 4/1/2008 3:09 AM
To: Annabelle Leung Fook Cheong; Bruce Mellado Garcia; ajit@hep.wisc.edu; dan@hep.wisc.edu; Sridhara Dasu; rader@ginseng.hep.wisc.edu; radtke@physics.wisc.edu; wcmaier@hep.wisc.edu; Sau Lan Wu
Subject: [issue5166] permissions problems on afs again




Neng & Mengmeng:

There should be a good installation of AtlasProduction 13.2.0 in
/afs/hep.wisc.edu/atlas/osg/atlas_app/atlas_rel/13.2.0. 

In the future, please try something like this:

 ssh login.hep.wisc.edu
 cd /scratch
 mkdir 13.x.y
 cd 13.x.y
 install AtlasProduction
 mkdir /afs/hep.wisc.edu/atlas/osg/atlas_app/atlas_rel/13.x.y
 cp -R -p . /afs/hep.wisc.edu/atlas/osg/atlas_app/atlas_rel/13.x.y/
 rm -rf /scratch/13.x.y

Let me know if you more help.

steve
--

 > ---- Original Message ----
 > From: Steve Rader via UW-HEP Help System <help@hep.wisc.edu>
 >
 > I just spoke with Mengeng Chen <mchen@cs.wisc.edu> on the
 > phone.  He reports that even just...
 >
 >  cp -R <localdisk> /afs/hep/atlas/...
 >
 > mysteriously fails on higgs06.cs.wisc.edu (or maybe some other
 > higgsXX.cs.wisc.edu host) despite having a valid AFS token!
 >
 > I was able to install AtlasProduction 13.2.0 in /afs/hep/home/radert
 > on Friday.   I'm trying to replicate Mengeng's problem now and will
 > report back later today.
 >
 > steve
 > --
 >
 > ______________________________________
 > UW-HEP Help System <help@hep.wisc.edu>
 > <https://help.hep.wisc.edu/issue5166>
 > ______________________________________

----------
status: chatting -> resolved

______________________________________
UW-HEP Help System <help@hep.wisc.edu>
<https://help.hep.wisc.edu/issue5166>
______________________________________

Neng & Mengmeng:

There should be a good installation of AtlasProduction 13.2.0 in
/afs/hep.wisc.edu/atlas/osg/atlas_app/atlas_rel/13.2.0.  

In the future, please try something like this:

 ssh login.hep.wisc.edu
 cd /scratch
 mkdir 13.x.y
 cd 13.x.y
 install AtlasProduction
 mkdir /afs/hep.wisc.edu/atlas/osg/atlas_app/atlas_rel/13.x.y
 cp -R -p . /afs/hep.wisc.edu/atlas/osg/atlas_app/atlas_rel/13.x.y/
 rm -rf /scratch/13.x.y

Let me know if you more help.

steve
--

 > ---- Original Message ----
 > From: Steve Rader via UW-HEP Help System <help@hep.wisc.edu>
 > 
 > I just spoke with Mengeng Chen <mchen@cs.wisc.edu> on the 
 > phone.  He reports that even just...
 > 
 >  cp -R <localdisk> /afs/hep/atlas/... 
 > 
 > mysteriously fails on higgs06.cs.wisc.edu (or maybe some other
 > higgsXX.cs.wisc.edu host) despite having a valid AFS token!
 > 
 > I was able to install AtlasProduction 13.2.0 in /afs/hep/home/radert
 > on Friday.   I'm trying to replicate Mengeng's problem now and will
 > report back later today.
 > 
 > steve
 > --
 > 
 > ______________________________________
 > UW-HEP Help System <help@hep.wisc.edu>
 > <https://help.hep.wisc.edu/issue5166>
 > ______________________________________

Thanks a lot, Steve.

Mengmeng
----- Original Message ----- 
From: "Steve Rader via UW-HEP Help System" <help@hep.wisc.edu>
To: <Annabelle.Leung@cern.ch>; <Bruce.Mellado.Garcia@cern.ch>; 
<ajit@hep.wisc.edu>; <dan@hep.wisc.edu>; <dasu@hep.wisc.edu>; 
<mengmeng.chen@cern.ch>; <neng.xu@cern.ch>; <rader@ginseng.hep.wisc.edu>; 
<radtke@physics.wisc.edu>; <wcmaier@hep.wisc.edu>; <wu@wisconsin.cern.ch>
Sent: March 31, 2008 5:00 PM
Subject: [issue5166] permissions problems on afs again



I just spoke with Mengeng Chen <mchen@cs.wisc.edu> on the
phone.  He reports that even just...

 cp -R <localdisk> /afs/hep/atlas/...

mysteriously fails on higgs06.cs.wisc.edu (or maybe some other
higgsXX.cs.wisc.edu host) despite having a valid AFS token!

I was able to install AtlasProduction 13.2.0 in /afs/hep/home/radert
on Friday.   I'm trying to replicate Mengeng's problem now and will
report back later today.

steve
--

______________________________________
UW-HEP Help System <help@hep.wisc.edu>
<https://help.hep.wisc.edu/issue5166>
______________________________________

I just spoke with Mengeng Chen <mchen@cs.wisc.edu> on the 
phone.  He reports that even just...

 cp -R <localdisk> /afs/hep/atlas/... 

mysteriously fails on higgs06.cs.wisc.edu (or maybe some other
higgsXX.cs.wisc.edu host) despite having a valid AFS token!

I was able to install AtlasProduction 13.2.0 in /afs/hep/home/radert
on Friday.   I'm trying to replicate Mengeng's problem now and will
report back later today.

steve
--

Hi Steve,

Some other points.

- I installed it on higgs06. It's SLC4 32bit machine.

- The recipe I sent to you can only run on 32bit machine.

- you can remove /afs/hep.wisc.edu/atlas/osg/atlas_app/atlas_rel/13.2.0 
directory.

Cheers,
Neng

Steve Rader via UW-HEP Help System wrote:
> Nen,
>
> Please send along a recipe for recreating this situation.
>
> I'm going try your installation in a completely new (test)
> AFS cell.
>
> steve
> --
>
>  > ---- Original Message ----
>  > From: Neng Xu <neng.xu@cern.ch>
>  > Hi Will,
>  > 
>  > Unfortunately, the installation failed due to the permission problem.
>  > 
>  > [nengxu@higgs06 13.2.0]$ ls
>  > AtlasLogin  AtlasSettings  CMT  cmtsite  external  geant4  
>  > Geant4_geant4_8_3_patch01_atlas00_i686_slc4_gcc34_opt.tar.gz  
>  > o..pacman..o  sw  trusted.caches
>  > [nengxu@higgs06 13.2.0]$ touch x
>  > touch: cannot touch `x': Permission denied
>  > [nengxu@higgs06 13.2.0]$ pwd
>  > /afs/hep.wisc.edu/atlas/osg/atlas_app/atlas_rel/13.2.0
>  > 
>  > Cheers,
>  > Neng
>  > 
>  > 
>  > Will Maier via UW-HEP Help System wrote:
>  > > Hi Annabelle-
>  > >
>  > > On Thu, Mar 20, 2008 at 05:47:03PM +0000, Annabelle Leung via UW-HEP Help System wrote:
>  > >   
>  > >> It seems like I am having permissions problems when writing to
>  > >> /afs/hep.wisc.edu/atlas again. I logged on to higgs05, did klog,
>  > >> have valid tokens and started dloading the ATHENA package. After
>  > >> some time (< 1 hour) the files could not download  anymore because
>  > >> I did not have permissions to write in the dir although the tokens
>  > >> were still valid. I had to relogin and redo klog to be able to
>  > >> delete the directory.
>  > >>
>  > >> Neng is trying again from  higgs06 and will let you know how it
>  > >> goes from there.
>  > >>     
>  > >
>  > > Was Neng able to complete the installation? We discussed this
>  > > problem again at our computing meeting today, and we'd very much
>  > > like to know if Neng had any success.
>  > >
>  > > Sridhara said Steve would check in again on this issue when Steve
>  > > returns next week.
>  > >
>  > > Thanks!
>  > >
>  > >
>
> ______________________________________
> UW-HEP Help System <help@hep.wisc.edu>
> <https://help.hep.wisc.edu/issue5166>
> ______________________________________
>

Hi Steve,

Here is the steps:

 > source /afs/hep.wisc.edu/atlas/pacman-3.21/setup.sh
 > mkdir /afs/hep.wisc.edu/atlas/osg/atlas_app/atlas_rel/13.2.0
 > cd /afs/hep.wisc.edu/atlas/osg/atlas_app/atlas_rel/13.2.0
 > pacman -allow tar-overwrite -get 
http://atlas-computing.web.cern.ch/atlas-computing/links/kitsDirectory/projects/cache:AtlasProduction_13_2_0_i686_slc4_gcc34_opt.pacman

Thanks you very much for helping.

Neng

Steve Rader via UW-HEP Help System wrote:
> Nen,
>
> Please send along a recipe for recreating this situation.
>
> I'm going try your installation in a completely new (test)
> AFS cell.
>
> steve
> --
>
>  > ---- Original Message ----
>  > From: Neng Xu <neng.xu@cern.ch>
>  > Hi Will,
>  > 
>  > Unfortunately, the installation failed due to the permission problem.
>  > 
>  > [nengxu@higgs06 13.2.0]$ ls
>  > AtlasLogin  AtlasSettings  CMT  cmtsite  external  geant4  
>  > Geant4_geant4_8_3_patch01_atlas00_i686_slc4_gcc34_opt.tar.gz  
>  > o..pacman..o  sw  trusted.caches
>  > [nengxu@higgs06 13.2.0]$ touch x
>  > touch: cannot touch `x': Permission denied
>  > [nengxu@higgs06 13.2.0]$ pwd
>  > /afs/hep.wisc.edu/atlas/osg/atlas_app/atlas_rel/13.2.0
>  > 
>  > Cheers,
>  > Neng
>  > 
>  > 
>  > Will Maier via UW-HEP Help System wrote:
>  > > Hi Annabelle-
>  > >
>  > > On Thu, Mar 20, 2008 at 05:47:03PM +0000, Annabelle Leung via UW-HEP Help System wrote:
>  > >   
>  > >> It seems like I am having permissions problems when writing to
>  > >> /afs/hep.wisc.edu/atlas again. I logged on to higgs05, did klog,
>  > >> have valid tokens and started dloading the ATHENA package. After
>  > >> some time (< 1 hour) the files could not download  anymore because
>  > >> I did not have permissions to write in the dir although the tokens
>  > >> were still valid. I had to relogin and redo klog to be able to
>  > >> delete the directory.
>  > >>
>  > >> Neng is trying again from  higgs06 and will let you know how it
>  > >> goes from there.
>  > >>     
>  > >
>  > > Was Neng able to complete the installation? We discussed this
>  > > problem again at our computing meeting today, and we'd very much
>  > > like to know if Neng had any success.
>  > >
>  > > Sridhara said Steve would check in again on this issue when Steve
>  > > returns next week.
>  > >
>  > > Thanks!
>  > >
>  > >
>
> ______________________________________
> UW-HEP Help System <help@hep.wisc.edu>
> <https://help.hep.wisc.edu/issue5166>
> ______________________________________
>

Nen,

Please send along a recipe for recreating this situation.

I'm going try your installation in a completely new (test)
AFS cell.

steve
--

 > ---- Original Message ----
 > From: Neng Xu <neng.xu@cern.ch>
 > Hi Will,
 > 
 > Unfortunately, the installation failed due to the permission problem.
 > 
 > [nengxu@higgs06 13.2.0]$ ls
 > AtlasLogin  AtlasSettings  CMT  cmtsite  external  geant4  
 > Geant4_geant4_8_3_patch01_atlas00_i686_slc4_gcc34_opt.tar.gz  
 > o..pacman..o  sw  trusted.caches
 > [nengxu@higgs06 13.2.0]$ touch x
 > touch: cannot touch `x': Permission denied
 > [nengxu@higgs06 13.2.0]$ pwd
 > /afs/hep.wisc.edu/atlas/osg/atlas_app/atlas_rel/13.2.0
 > 
 > Cheers,
 > Neng
 > 
 > 
 > Will Maier via UW-HEP Help System wrote:
 > > Hi Annabelle-
 > >
 > > On Thu, Mar 20, 2008 at 05:47:03PM +0000, Annabelle Leung via UW-HEP Help System wrote:
 > >   
 > >> It seems like I am having permissions problems when writing to
 > >> /afs/hep.wisc.edu/atlas again. I logged on to higgs05, did klog,
 > >> have valid tokens and started dloading the ATHENA package. After
 > >> some time (< 1 hour) the files could not download  anymore because
 > >> I did not have permissions to write in the dir although the tokens
 > >> were still valid. I had to relogin and redo klog to be able to
 > >> delete the directory.
 > >>
 > >> Neng is trying again from  higgs06 and will let you know how it
 > >> goes from there.
 > >>     
 > >
 > > Was Neng able to complete the installation? We discussed this
 > > problem again at our computing meeting today, and we'd very much
 > > like to know if Neng had any success.
 > >
 > > Sridhara said Steve would check in again on this issue when Steve
 > > returns next week.
 > >
 > > Thanks!
 > >
 > >

Hi Will,

Unfortunately, the installation failed due to the permission problem.

[nengxu@higgs06 13.2.0]$ ls
AtlasLogin  AtlasSettings  CMT  cmtsite  external  geant4  
Geant4_geant4_8_3_patch01_atlas00_i686_slc4_gcc34_opt.tar.gz  
o..pacman..o  sw  trusted.caches
[nengxu@higgs06 13.2.0]$ touch x
touch: cannot touch `x': Permission denied
[nengxu@higgs06 13.2.0]$ pwd
/afs/hep.wisc.edu/atlas/osg/atlas_app/atlas_rel/13.2.0

Cheers,
Neng


Will Maier via UW-HEP Help System wrote:
> Hi Annabelle-
>
> On Thu, Mar 20, 2008 at 05:47:03PM +0000, Annabelle Leung via UW-HEP Help System wrote:
>   
>> It seems like I am having permissions problems when writing to
>> /afs/hep.wisc.edu/atlas again. I logged on to higgs05, did klog,
>> have valid tokens and started dloading the ATHENA package. After
>> some time (< 1 hour) the files could not download  anymore because
>> I did not have permissions to write in the dir although the tokens
>> were still valid. I had to relogin and redo klog to be able to
>> delete the directory.
>>
>> Neng is trying again from  higgs06 and will let you know how it
>> goes from there.
>>     
>
> Was Neng able to complete the installation? We discussed this
> problem again at our computing meeting today, and we'd very much
> like to know if Neng had any success.
>
> Sridhara said Steve would check in again on this issue when Steve
> returns next week.
>
> Thanks!
>
>

Hi Annabelle-

On Thu, Mar 20, 2008 at 05:47:03PM +0000, Annabelle Leung via UW-HEP Help System wrote:
> It seems like I am having permissions problems when writing to
> /afs/hep.wisc.edu/atlas again. I logged on to higgs05, did klog,
> have valid tokens and started dloading the ATHENA package. After
> some time (< 1 hour) the files could not download  anymore because
> I did not have permissions to write in the dir although the tokens
> were still valid. I had to relogin and redo klog to be able to
> delete the directory.
> 
> Neng is trying again from  higgs06 and will let you know how it
> goes from there.

Was Neng able to complete the installation? We discussed this
problem again at our computing meeting today, and we'd very much
like to know if Neng had any success.

Sridhara said Steve would check in again on this issue when Steve
returns next week.

Thanks!

-- 

o--------------------------{ Will Maier }--------------------------o
| jabber:...wcmaier@xmpp.lfod.us | email:..will.maier@hep.wisc.edu |
| office:...........608.263.9692 | cell:..............608.438.6162 |
*--------------------[ UW High Energy Physics ]--------------------*

Hello all,

It seems like I am having permissions problems when writing to /afs/hep.wisc.edu/atlas again. I logged on to higgs05, did klog, have valid tokens and started dloading the ATHENA package. After some time (< 1 hour) the files could not download  anymore because I did not have permissions to write in the dir although the tokens were still valid. I had to relogin and redo klog to be able to delete the directory.

Neng is trying again from  higgs06 and will let you know how it goes from there.

Annabelle