2021-05-05-hifis-transfer-service.md 2.17 KB
Newer Older
Uwe Jandt (DESY, HIFIS)'s avatar
Uwe Jandt (DESY, HIFIS) committed
1
---
Uwe Jandt (DESY, HIFIS)'s avatar
Uwe Jandt (DESY, HIFIS) committed
2
title: "HIFIS Transfer Service: Sharing large data sets in Helmholtz"
Uwe Jandt (DESY, HIFIS)'s avatar
Uwe Jandt (DESY, HIFIS) committed
3
4
5
6
7
8
9
10
11
12
13
14
15
title_image: omar-flores-MOO6k3RaiwE-unsplash.jpg
data: 2021-05-05
authors:
  - wetzel
  - jandt
layout: blogpost
categories:
  - news
excerpt: >
    The HIFIS Transfer Service (HTS) enables the Helmholtz centres to easily share large data set in collaborations.

---

16
# Large Data Transfer for Helmholtz
Uwe Jandt (DESY, HIFIS)'s avatar
Uwe Jandt (DESY, HIFIS) committed
17
18
19

The HIFIS Transfer Service (HTS) enables the Helmholtz centres to easily share large data set in collaborations.

20
21
#### How is this implemented?

Uwe Jandt (DESY, HIFIS)'s avatar
Uwe Jandt (DESY, HIFIS) committed
22
To achieve this, [WebFTS](https://webfts.fedcloud-tf.fedcloud.eu/) is used as graphical frontend.
23
24
25
26
It enables the user to commission data transfers with CERN's backend service FTS3.

FTS3 controls transfers between an active and a passive endpoint at the involved centres.
The main advantage of using FTS3 compared to commonly used FTP or SCP based transfers is that no active involvement by the user is needed after commissioning the transfer. Hence, users can schedule the transfer, e.g. overnight, and have the data ready for use later.
Uwe Jandt (DESY, HIFIS)'s avatar
Uwe Jandt (DESY, HIFIS) committed
27
28


29
#### What are the preconditions to use HTS?
Uwe Jandt (DESY, HIFIS)'s avatar
Uwe Jandt (DESY, HIFIS) committed
30

31
32
33
34
In order to use HTS, a centre needs to:
* be connected to Helmholtz AAI (see [list](https://hifis.net/doc/backbone-aai/list-of-connected-centers/)),
* install a dedicated endpoint that is capable of communicating with FTS3 either actively or passively, and
* of course, provide sufficiently large, performant and available storage to which the endpoint has access to.
Uwe Jandt (DESY, HIFIS)'s avatar
Uwe Jandt (DESY, HIFIS) committed
35
36
37
38

At the time of writing, HIFIS offers a passive endpoint solution in form of an Apache webserver for installation at a centre.
Configuration and installation instructions can be [found in the Technical Documentation](https://hifis.net/doc/core-services/fts-endpoint/).

39
An active endpoint that can be used as a relay point between two passive endpoints is also available at DESY.
Uwe Jandt (DESY, HIFIS)'s avatar
Uwe Jandt (DESY, HIFIS) committed
40
41
42

#### Support

43
If you want to set up data transfer for your needs, or in case of any questions and queries, please don't hesitate to write us.
Uwe Jandt (DESY, HIFIS)'s avatar
Uwe Jandt (DESY, HIFIS) committed
44
45
46

<a href="{% link contact.md %}" 
                            class="btn btn-outline-secondary"
47
                            title="HIFIS Helpdesk"> 
Uwe Jandt (DESY, HIFIS)'s avatar
Uwe Jandt (DESY, HIFIS) committed
48
                            Contact us! <i class="fas fa-envelope"></i></a>