Commit 5cd5e708 authored by Uwe Jandt (DESY, HIFIS)'s avatar Uwe Jandt (DESY, HIFIS) 💬
Browse files

Merge branch 'hifis-unified-step-1-after-vc-20210317' into hifis-unified-step-1-with-quickstartlane

parents 32077617 0541ee03
Pipeline #72211 passed with stages
in 5 minutes and 4 seconds
......@@ -10,6 +10,6 @@ gem 'jekyll-feed', '~> 0.15.1'
gem "jekyll-sitemap", "~> 1.4"
group :test do
gem 'html-proofer', '~> 3.19.0'
gem 'html-proofer', '~> 3.19.1'
gem 'yaml-lint', '~>0.0.7'
end
......@@ -8,12 +8,12 @@ GEM
em-websocket (0.5.2)
eventmachine (>= 0.12.9)
http_parser.rb (~> 0.6.0)
ethon (0.13.0)
ethon (0.14.0)
ffi (>= 1.15.0)
eventmachine (1.2.7)
ffi (1.15.0)
forwardable-extended (2.6.0)
html-proofer (3.19.0)
html-proofer (3.19.1)
addressable (~> 2.3)
mercenary (~> 0.3)
nokogumbo (~> 2.0)
......@@ -59,7 +59,7 @@ GEM
rb-fsevent (~> 0.10, >= 0.10.3)
rb-inotify (~> 0.9, >= 0.9.10)
mercenary (0.4.0)
mini_portile2 (2.5.0)
mini_portile2 (2.5.1)
nokogiri (1.11.3)
mini_portile2 (~> 2.5.0)
racc (~> 1.4)
......@@ -91,7 +91,7 @@ PLATFORMS
ruby
DEPENDENCIES
html-proofer (~> 3.19.0)
html-proofer (~> 3.19.1)
jekyll (~> 4.2.0)
jekyll-feed (~> 0.15.1)
jekyll-paginate (~> 1.1.0)
......
......@@ -111,3 +111,12 @@
rank: 1
associate: false
cluster: software
- id: wetzel
name: "Wetzel, Tim"
location:
campus: desy
position: "HIFIS Backbone Services"
associate: false
rank: 0
associate: false
cluster: backbone
......@@ -10,7 +10,7 @@ start:
end:
time: "15:00"
location:
campus: "virtual"
campus: "Online"
room: "<a href=https://meet.gwdg.de/b/max-93j-2ef><i class=\"fas fa-external-link-alt\"></i> meet.gwdg.de</a>"
excerpt: "<strong>Why don't you share your source code?</strong> Concerns about and solutions for common problems with code sharing."
---
......
......@@ -10,7 +10,7 @@ start:
end:
time: "15:00"
location:
campus: "virtual"
campus: "Online"
room: "<a href=https://meet.gwdg.de/b/max-93j-2ef><i class=\"fas fa-external-link-alt\"></i> meet.gwdg.de</a>"
excerpt: "<strong>Project organization for software development in research</strong> Important but often neglected in research -> project organization in software development"
---
......
......@@ -10,7 +10,7 @@ start:
end:
time: "15:00"
location:
campus: "virtual"
campus: "Online"
room: "<a href=https://meet.gwdg.de/b/max-93j-2ef><i class=\"fas fa-external-link-alt\"></i> meet.gwdg.de</a>"
excerpt: "<strong>What could go wrong? Horror Stories in (collaborative) scientific computation</strong> The moment they realized their work of the past years was almost wasted..."
---
......
......@@ -10,7 +10,7 @@ start:
end:
time: "15:00"
location:
campus: "virtual"
campus: "Online"
room: "<a href=https://meet.gwdg.de/b/max-93j-2ef><i class=\"fas fa-external-link-alt\"></i> meet.gwdg.de</a>"
excerpt: "<strong>How to select the right tools in software development?</strong> How to avoid not to get lost inside multiple tools available when choosing for software development?"
---
......
......@@ -10,7 +10,7 @@ start:
end:
time: "15:00"
location:
campus: "virtual"
campus: "Online"
room: "<a href=https://meet.gwdg.de/b/max-93j-2ef><i class=\"fas fa-external-link-alt\"></i> meet.gwdg.de</a>"
excerpt: "<strong>My preferred data visualization tools</strong> There are hundreds of libraries and tools to solve that, but which one is the best?"
---
......
......@@ -10,7 +10,7 @@ start:
end:
time: "15:00"
location:
campus: "virtual"
campus: "Online"
room: "<a href=https://meet.gwdg.de/b/max-93j-2ef><i class=\"fas fa-external-link-alt\"></i> meet.gwdg.de</a>"
excerpt: "<strong>Helmholtz services that can assist you in research software development</strong> These tools might make your daily work easier..."
---
......
......@@ -10,7 +10,7 @@ start:
end:
time: "15:00"
location:
campus: "virtual"
campus: "Online"
room: "<a href=https://meet.gwdg.de/b/max-93j-2ef><i class=\"fas fa-external-link-alt\"></i> meet.gwdg.de</a>"
excerpt: "<strong>Automation in research software development</strong> Automation as one of the keys towards reproducible research."
---
......
......@@ -10,7 +10,7 @@ start:
end:
time: "15:00"
location:
campus: "virtual"
campus: "Online"
room: "<a href=https://meet.gwdg.de/b/max-93j-2ef><i class=\"fas fa-external-link-alt\"></i> meet.gwdg.de</a>"
excerpt: "<strong>Lost in translation</strong> Tools for rewriting code"
---
......
......@@ -10,7 +10,7 @@ start:
end:
time: "15:00"
location:
campus: "virtual"
campus: "Online"
room: "<a href=https://meet.gwdg.de/b/max-93j-2ef><i class=\"fas fa-external-link-alt\"></i> meet.gwdg.de</a>"
excerpt: "<strong>Pitfalls in data visualization</strong> Why people don't understand exponential growth and what color it has."
---
......
......@@ -10,7 +10,7 @@ start:
end:
time: "15:00"
location:
campus: "virtual"
campus: "Online"
room: "<a href=https://meet.gwdg.de/b/max-93j-2ef><i class=\"fas fa-external-link-alt\"></i> meet.gwdg.de</a>"
excerpt: "<strong>Time & quality - a wicked problem</strong> How to decide when enough is enough"
---
......
......@@ -10,7 +10,7 @@ start:
end:
time: "15:00"
location:
campus: "virtual"
campus: "Online"
room: "<a href=https://meet.gwdg.de/b/max-93j-2ef><i class=\"fas fa-external-link-alt\"></i> meet.gwdg.de</a>"
excerpt: "<strong>Working effectively with bad or old code</strong> When the code is older than the programmer and your research depends on a cryptic combination of characters…"
---
......
......@@ -10,7 +10,7 @@ start:
end:
time: "15:00"
location:
campus: "virtual"
campus: "Online"
room: "<a href=https://meet.gwdg.de/b/max-93j-2ef><i class=\"fas fa-external-link-alt\"></i> meet.gwdg.de</a>"
excerpt: "<strong>When to parallelize your software</strong> It is running for three hours while only doing simple calculations..."
---
......
......@@ -10,7 +10,7 @@ start:
end:
time: "15:00"
location:
campus: "virtual"
campus: "Online"
room: "<a href=https://meet.gwdg.de/b/max-93j-2ef><i class=\"fas fa-external-link-alt\"></i> meet.gwdg.de</a>"
excerpt: "<strong>Tools for handling (parametric) 3D-models</strong> Plotting in 2D is nice, but sometimes it is simply not enough."
---
......
......@@ -137,7 +137,7 @@
</div>
<div class="info-box">
<a href="{% link organisation/documentation.md %}" class="btn btn-outline-primary">
<a href="{% link documentation.md %}" class="btn btn-outline-primary">
<h3><i class="fas fa-atom" aria-hidden="true"></i>&nbsp; Documentation</h3>
</a>
<p>See here for HIFIS Technical and Administrative Documentation, Policies and Internal Repositories.
......@@ -145,10 +145,10 @@
</div>
<div class="info-box">
<a href="{% link organisation/index.html %}" class="btn btn-outline-primary">
<h3><i class="fas fa-atom" aria-hidden="true"></i>&nbsp; Team and Organisation</h3>
<a href="{% link structure/index.html %}" class="btn btn-outline-primary">
<h3><i class="fas fa-atom" aria-hidden="true"></i>&nbsp; Structure and Governance</h3>
</a>
<p>See here for insight into the organization of HIFIS, the HIFIS team and governance.</p>
<p>See here for insights into the organisation of HIFIS, the HIFIS clusters and governance.</p>
</div>
<div class="info-box">
......
......@@ -29,7 +29,9 @@ It does on purpose NOT include the content of the markdown page.
<h1>Team</h1>
<div class="team_list">
{%- for person in team_members_core -%}
{%- if person.rank >= 1 -%}
{%- include team_card.html person=person -%}
{%- endif -%}
{%- endfor -%}
</div>
</div>
......
---
title: "HIFIS Transfer Service: Sharing large data sets"
title_image: omar-flores-MOO6k3RaiwE-unsplash.jpg
data: 2021-05-05
authors:
- wetzel
- jandt
layout: blogpost
categories:
- news
excerpt: >
The HIFIS Transfer Service (HTS) enables the Helmholtz centres to easily share large data set in collaborations.
---
# Large Data Transfer for Helmholtz
The HIFIS Transfer Service (HTS) enables the users at the Helmholtz centres to easily share large data sets in collaborations.
#### How is this implemented?
To achieve this, WebFTS is used as graphical frontend.
It enables the user to commission data transfers with CERN's backend service FTS3.
FTS3 controls transfers between an active and a passive endpoint at the involved centres.
The main advantage of using FTS3 compared to commonly used FTP or SCP based transfers is that no active involvement by the user is needed after commissioning the transfer. Hence, users can schedule the transfer, e.g. overnight, and have the data ready for use later.
#### What are the preconditions to use HTS?
In order to participate in HTS, a centre needs to:
* be connected to Helmholtz AAI (see [list](https://hifis.net/doc/backbone-aai/list-of-connected-centers/)),
* install a dedicated endpoint that is capable of communicating with FTS3 either actively or passively, and
* of course, provide sufficiently large, performant and available storage to which the endpoint has access.
At the time of writing, HIFIS offers a passive endpoint solution in form of an Apache webserver for installation at a centre.
Configuration and installation instructions can be [found in the Technical Documentation](https://hifis.net/doc/core-services/fts-endpoint/).
An active endpoint that can be used as a relay point between two passive endpoints is also available at DESY.
#### How to use HTS?
If the preconditions are fulfilled, you need to do the following steps to use HTS:
* know the URLs of the endpoints you want to use (available from the centre if they are participating in HTS),
* access [WebFTS](https://webfts.fedcloud-tf.fedcloud.eu/) in your browser,
* log in via Helmholtz AAI (upper left corner),
* click on 'Submit a transfer',
* enter the URLs of the endpoints between you want to transfer data,
* select the data you want to transfer on one endpoint,
* click on one of the arrows between the directory views according to the direction of the transfer.
After submitting, you should see a banner stating that your transfer has been submitted successfully. You can check the transfer status by clicking on 'My jobs'.
#### Support
If you want to set up data transfers for your needs, or in case of any questions and queries, please don't hesitate to write us.
<a href="{% link contact.md %}"
class="btn btn-outline-secondary"
title="HIFIS Helpdesk">
Contact us! <i class="fas fa-envelope"></i></a>
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment