HLT

Those pages are provided for the High Level Trigger activities.

HLT Linux Cluster User's Guide

HLT Linux Cluster User's Guide
- Howe to get an account on HLT Farm

  1. Get an account to the STAR Protected Network. See instructions at https://drupal.star.bnl.gov/STAR/comp/onl/accessing-star-protected-network
  2. Once you can access STAR online gate way stargw.starp.bnl.gov, send an email to starsupport@bnl.gov (cc to me: kehw@bnl.gov) to request your access to xeon-phi-dev.starp.bnl.gov, which is the entry point to the HLT cluster.

- How to login HLT cluster
The STAR HLT cluster sites in a local network, which has an entry point to the STAR online network.
To reach the cluster, one need to jump a few time via ssh.
1. (if you are outside of BNL) Connect to the RCF gateway rssh.rhic.bnl.gov or cssh.rhic.bnl.gov.
The RCF NX service is recommended for better graphics performance.
https://www.racf.bnl.gov/docs/services/nx

2. From the RCF gateway or the NX node, connect to the STAR gateway: stargw.starp.bnl.gov
You must have a STAR online enclave account to be able to do this.
https://drupal.star.bnl.gov/STAR/comp/onl/accessing-star-protected-network

3. From the STAR gateway, connect to the HLT cluster entry point: xeon-phi-dev.starp.bnl.gov (aka L409)
Now you are on STAR HLT cluster.

The ssh ProxyJump or ProxyCommand is recommended to jump through multiple hosts
https://en.wikibooks.org/wiki/OpenSSH/Cookbook/Proxies_and_Jump_Hosts#Passing_Through_One_or_More_Gateways_Using_ProxyJump

- Computing Environment

   * SL 7.3
   * No STAR environment pre-configured.
   * If you need the STAR environment, add the following lines in you ~/.cshrc
--------------------------------------------------------------------------

source /net/l402/data/fisyak/STAR/packages/.DEV2/setupDEV2.csh
setup NODEBUG
setup 64b
starver TFG18m
--------------------------------------------------------------------------

- NFS mounted home dir: /star/u/[user name]
Size: 1.3TB, RAID 5, no quota yet, but please use your home dir wisely

 - NFS mounted Storage
/net/l401/data/scratch[1,2]
/net/l402/data
/net/l403/data
/net/l404/data
* 10+TB each, available on all HLT nodes.

- Ceph storate
On all nodes
/hlt/cephfs

 - Condor Queue: Intel Xeon E5-2670 @ 2.50GHz
condor submitter: xeon-phi-dev.starp.bnl.gov (aka l409), l404

 - Intel Xeon Phi coprocessor 7120P
l405-l408, l410-l417, two cards per node
l409(xeon-phi-dev) one card
In order to use the coprocessor, Intel C/C++ compiler is needed, which can be found at
/opt/intel_17
Documentation for Intel compiler and libraries can be found at
https://software.intel.com/en-us/intel-parallel-studio-xe-support/documentation
More information about Xeon Phi KNC (1st generation, x100 family) can be found at
https://software.intel.com/en-us/articles/intel-xeon-phi-coprocessor-codename-knights-corner

- PGI Compiler
The PGI compiler community edition has been installed in
/software/pgi

One need the following settings to use the compilers

% setenv PGI /software/pgi
% set path=(/software/pgi/linux86-64/18.10/bin $path)
% setenv MANPATH "$MANPATH":/software/pgi/linux86-64/18.10/man
% setenv LM_LICENSE_FILE /software/pgi/license.dat:"$LM_LICENSE_FILE" 

---------------------------------------------------------------------------------
Contact Person:
Hongwei Ke
kehw@bnl.gov
631-344-4575

HLT QA

 

STAR HLT User's Manual

SpaceCharge and GridLeak Calibration for offline

calibration of SpaceCharge(SC) and GridLeak(GL)
 
cd /star/u/yjye/yjye1/HLT/SC_GL/run2018/AuAu27
 
operation step:
 
1. get the inital value of StarDb6.8_9/StarDb6.8_10/StarDb6.8_11, chain option of bfc.f and star version from Gene.
   a. time relationship: (early)beginTime on the website < filename of the StarDb* < daqfile(late). 
   
2. download the daqfile of this year which need to do calibration.
  a. open star RunLog and choose th daqfiles
  b. (20-30)daqfiles are needed and more than 5000 events for each daqfie.
  c. contain a wide lumilosity for those events in the daqfiles
  d. hpss_user.pl -f trans4
  d. we can confirm the download result on websit: http://www.star.bnl.gov/devcgi/display_accnt.cgi
 
3. cd submit
 
4. Use the StSpaceChargeEbyEMaker to create the root file from daq file for the following calibration.
   ./submit_all.bash
 
5. Use the function of doEvent_SCGL_Calib.C to calibrate the SC and GL from the input root file and create some histogram for the   next fitting.
   ./run_step2.bash
 
6. ./moveHist.bash
 
7. Fit the histogram and get the SC and GL.
   cd ../ and ./run_all.csh

SpaceCharge and GridLeak Calibration for online

 calibaration of SpaceCharge(SC) and GridLeak(GL) with online

 
cd /star/u/yjye/yjye1/HLT/SpaceCharge/SpaceCharge/online/RTS/src/L4_HLT
 
operation step:
 
1. we need to files, "HLTConfig" and "conf_18171003.xml" in the run_l4Emulator.csh, which is supported by Hongwei. 
 
2. set the value of "spaceCharge" in online_tracking_TpcHitMap.cxx. The value is decided by the sc which is calculated on the
   offline. The step of the value change is 0.001 or 0.002.
 
3. ./run_ye18171003.csh