1. Condor Week 2012 - May 2012Remote Condor1 Condor Week 2012 Remote Condor presented by J. M. Dost co-author I. Sfiligoi UC San Diego

2. Condor Week 2012 - May 2012Remote Condor2 Overview ● What is “Remote Condor”? ● Why you may want to use it? ● Detailed instructions ● Live demo

3. Condor Week 2012 - May 2012Remote Condor3 What is “Remote Condor”? ● In simple words ● Condor over SSH ● Available from the Condor contrib sections as RCondor sshd Schedd node Schedd User node Auth https://condor-wiki.cs.wisc.edu/index.cgi/wiki?p=RemoteCondor

4. Condor Week 2012 - May 2012Remote Condor4 RCondor Commands ● Rcondor provides wrappers for several common Condor command line tools ● condor_submit, condor_q, etc. ● Looks like local to user ● In reality, they are executed on the remote node sshd Schedd node Schedd condor_submit condor_q User node Auth condor_submit condor_q

5. Condor Week 2012 - May 2012Remote Condor5 File handling ● Of course, you need access to files ● e.g. JDL, input and output files ● Using SSHFS for this ● A popular FUSE file system sshd Schedd node Schedd User node Auth Real disk sshfs

6. Condor Week 2012 - May 2012Remote Condor6 Why should you care about it? ● There definitely are alternatives ● e.g. remote submission and Condor-C ● However, “Remote Condor” ● Ties nicely with existing auth mechanisms (SSH) ● No servers to run locally ● Wifi friendy ● Easy to install and configure Compared to installing a personal Condor instance

7. Condor Week 2012 - May 2012Remote Condor7 Compared to manual ssh... ● Of course, one can always tell users to explicitly ssh into the schedd node sshd Schedd node Schedd condor_submit condor_q User node Auth Real disk

8. Condor Week 2012 - May 2012Remote Condor8 Compared to manual ssh... ● Of course, one can always tell users to explicitly ssh into the schedd node ● But “Remote Condor” makes it more user friendly ● Looks and feels completely local – And if set up by the sys admin, users may even be unaware of the disguise ● Plus, it can transparently work with GUIs

9. Condor Week 2012 - May 2012Remote Condor9 Install and configuration instructions

10. Condor Week 2012 - May 2012Remote Condor10 Installation ● Get Condor SRC tarball ● Go into src/condor_contrib/rcondor ● Run make prefix=/your/location install

11. Condor Week 2012 - May 2012Remote Condor11 Configure ● Per-user configuration in $HOME/.rcondor/rcondor.conf ● Contains 3 lines USR_HOST = user@host LOCAL = mountpoint REMOTE = dir ● Helper config tool rcondor_configure user@host:dir mountpoint SSH coordinates SSHFS coordinates Public key auth strongly preferred (e.g. ssh keys or krb5)

12. Condor Week 2012 - May 2012Remote Condor12 Start work session ● Since you probably don't want to always mount the remote disk ● Start the work session with rcondor_mnt ● This will make the mount for you ● You are now ready to use Condor

13. Condor Week 2012 - May 2012Remote Condor13 Use Condor ● All files are accessible in the LOCAL tree directory ● Use ls, cp, etc. ● Or your favorite GUI ● Standard cmdline syntax condor_submit my_submit.jdl condor_q 12.34

14. Condor Week 2012 - May 2012Remote Condor14 Remote Condor Live Demo

15. Condor Week 2012 - May 2012Remote Condor15 Acknowledgments ● This work is partially sponsored by ● the US National Science Foundation under Grants No. OCI-0943725 (STCI) and PHY-0612805 (CMS Maintenance & Operations) ● and ● the US Department of Energy under Grant No. DE- FC02-06ER41436 subcontract No. 647F290 (OSG).