Enable HPSS archiving on C5/6 #3437
Conversation
DavidHuber-NOAA
requested review from
WalterKolczynski-NOAA and
aerorahul
as code owners
DavidHuber-NOAA
requested review from
KateFriedman-NOAA,
DavidBurrows-NCO and
AnilKumar-NOAA
|
@DavidHuber-NOAA I don't really have experience with HPSS archive in GW. I did however just get HPSS access from C6. Want me to set up your branch and test a C48_ATM with hpss transfer? |
|
@DavidBurrows-NCO Sure, if you wouldn't mind, I'd appreciate the extra test. Thanks! |
|
@DavidHuber-NOAA I'm having HPSS access issues after the maintenance and had to open a ticket. I'll keep you posted. If you want to proceed with this, feel free, and I can test once my access is updated. Please let me know. Thanks! |
|
Thanks for testing @DavidBurrows-NCO. Let's wait until you are able to test. If there was an issue after maintenance, then I would prefer it get resolved before merging this PR. |
There was a problem hiding this comment.
Looks good, thanks @DavidHuber-NOAA ! Approve pending successful completion of any testing.
| elif [[ ${MACHINE_ID} = gaeac5 ]] ; then | ||
| # We are on GAEA C5. | ||
| if ( ! eval module help > /dev/null 2>&1 ) ; then | ||
| source /usr/share/lmod/lmod/init/bash | ||
| # We cannot simply load the module command. The GAEA | ||
| # /etc/profile modifies a number of module-related variables | ||
| # before loading the module command. Without those variables, | ||
| # the module command fails. Hence we actually have to source | ||
| # /etc/profile here. | ||
| source /etc/profile | ||
| fi | ||
| module reset | ||
| elif [[ ${MACHINE_ID} = gaeac6 ]]; then | ||
| # We are on GAEA C6. | ||
| if ( ! eval module help > /dev/null 2>&1 ) ; then | ||
| source /opt/cray/pe/lmod/lmod/init/bash | ||
| fi | ||
| module reset |
There was a problem hiding this comment.
Description
This PR enables HPSS archiving on Gaea C6. The C5 hosts file is also updated, but has not been tested. The ES cluster needs to know which nodes to select based on which file system the files to archive are located. To accomplish this, the
--constraint=option was added for C5 and C6. This feature should have no change on other platforms.Resolves #3421
Refs #3261
Type of change
Change characteristics
How has this been tested?
C48_ATM test on Gaea C6
Checklist