1. archiver.ias.ethz.ch
easy to use solution for end user to store data on LTS strongbox.
requirements:
apache web-server to host end user frontend (php,html,jquery)
sftp-server on end user data location
database-server to store archive jobs
working-horse to execute archive jobs with large temp-storage and NFS access to LTS strongbox (perl-scripts)

2. archiver.ias.ethz.ch infrastructure
web-server
& working horse
remote sftp-server
SFTP
HTTPS
NFS
MySQL
NFS
client computer
temp storage
database-server
LTS strongbox

3. login with NETZ username password
login with NETZ username password
online demo!

4. sftp source configuration (e.g. FGCZ):
server configuration
sftp source configuration (e.g. FGCZ):
$GLOBALS['source']['fgcz-gstore']['host']='fgcz-gstore.uzh.ch';
$GLOBALS['source']['fgcz-gstore']['port']='666';
$GLOBALS['source']['fgcz-gstore']['basedirectory']='/projects';
perl-scripts:
netsftp_ls.pl to list files on remote host
netsftp_get.pl to get files from remote host and tar files to strongbox
netsftp_get.pl execute through cron-job every 15min if not already running.

5. log file view
[srv-rz-vm-1:/home/ltsuser/netsftp/log]# cat netsftp_get.log
:30 : connected
:31 : got /projects/p1049/Sequencing/ILLUMINA/Run_ /KasalathS3_1_R2.fastq.gz ( )
:34 : got /projects/p1049/Sequencing/ILLUMINA/Run_ /IR64S2_1_R2.fastq.gz ( )
:35 : got /projects/p1049/Sequencing/ILLUMINA/Run_ /KasalathS5_1_R2.fastq.gz ( )
:36 : got /projects/p1049/Sequencing/ILLUMINA/Run_ /DularS2_1_R2.fastq.gz ( )
:38 : got /projects/p1049/Sequencing/ILLUMINA/Run_ /KasalathS4_1_R1.fastq.gz ( )
:39 : got /projects/p1049/Sequencing/ILLUMINA/Run_ /KasalathS4_1_R2.fastq.gz ( )
:41 : got /projects/p1049/Sequencing/ILLUMINA/Run_ /DularS5_1_R2.fastq.gz ( )
:42 : got /projects/p1049/Sequencing/ILLUMINA/Run_ /IR64S4_1_R1.fastq.gz ( )
...
:38 : got /projects/p1049/Sequencing/ILLUMINA/Run_ /DularC1_1_R1.fastq.gz ( )
:40 : got /projects/p1049/Sequencing/ILLUMINA/Run_ /DularC1_1_R2.fastq.gz ( )
:41 : got /projects/p1049/Sequencing/ILLUMINA/Run_ /IR64C2_1_R1.fastq.gz ( )
:42 : got /projects/p1049/Sequencing/ILLUMINA/Run_ /KasalathC1_2_R1.fastq.gz ( )
:44 : got /projects/p1049/Sequencing/ILLUMINA/Run_ /IR64C2_1_R2.fastq.gz ( )
:45 : got /projects/p1049/Sequencing/ILLUMINA/Run_ /IR64S4_1_R2.fastq.gz ( )
:46 : got /projects/p1049/Sequencing/ILLUMINA/Run_ /DularS4_1_R2.fastq.gz ( )
:48 : got /projects/p1049/Sequencing/ILLUMINA/Run_ /DularC2_1_R2.fastq.gz ( )
:11 : tar'ed /nfs/strongbox/ias/netsftp/ _jonghwasky_2.tar ()
[srv-rz-vm-1:/home/ltsuser/netsftp/log]# cd /nfs/strongbox/ias/netsftp/
[srv-rz-vm-1:/nfs/strongbox/ias/netsftp]# ls -lart
total
drwxr-xr-x. 1 ltsuser ltsgroup Nov 13 14:55 ..
drwxr-xr-x. 1 ltsuser ltsgroup Nov 14 10:48 .
-rw-r--r--. 1 ltsuser ltsgroup Nov 14 11: _jonghwasky_2.tar
[srv-rz-vm-1:/nfs/strongbox/ias/netsftp]#

6. end user restore and delete function
things to do
(if needed?)
end user restore and delete function
problem here are the large tar-files so a predefined restore location must be available and accessible for the end user
admin-inferface
possible functions:
view log files
jobs control (edit, delete, relaunch)
restore jobs
...