Procedure to resolve problem is:

1. on EMC01.STARP.BNL.GOV (monitor is on top of SMD HV Control PC) open terminal window.
2. ping 130.199.60.50
3. observe that packets transmitted and received
   
4. if there are no communication wiht SY1527

   (packets lost) Call an expert!
    

5. if communication is OK, then stop ping and type

   telnet 130.199.60.50 1527

   Result:

   1. you should see 'login window for CAEN SY1527 system'
   2. press any key
   3. Login as 'admin' with password 'admin'

      Result:

      1. you will see Main Menu window for SY1527
      2. From 'Main' chose 'Channels' by pressing 'Enter'

         Result:

         1. you will see Channels menu window
         2. Verify HV is presented on channels (VMon)
            
            

Now you can operate HV using this window, but if there is no emergency to turn HV OFF you should first try to restart SMD HV Control program. Basic operations from that window are:

How to operate this window:

1. press Tab key
2. scroll to 'Groups' menu
3. press 'Enter' to chose "Group Mode"

   you will see highlighted column
    

4. scroll to "Pw"
5. press space bar

   you will see "Pw" will switched from On to Off and VMon will start to decrease.
   
   

Turn HV ON

1. press Tab key
2. select 'Group' mode
3. scroll to IOSet
4. type 5.0 (Current limit 5uA)
5. scroll to Trip
6. type 0.5 sec
7. Verify that V0Set is 1430 V
8. Scroll to Pw
9. press Space bar

You will see Pw will switch from OFF to ON. Status goes to Up and VMon will start to increase. Once HV will reach to nominal it is very important to switch I0Set to 1.6 uA and Trip to 0.1s on all channels. Some channels might trip after I0Set and Trip were changed, that is 'normal'. For those channels I0Set and Trip should be set to 5 uA and 0.5s. To do that:

1. Press Tab key
2. reselect 'Group' mode
3. Change I0Set and Trip for tripped channels
4. Power them up - scroll to Pw, and press Space bar.
   
   

Usually it is safe to keep channels in 'Group' mode to be able to switch them OFF fast in case of emergency.

Appendix

Before you start:

"Be afraid, even paranoid, and that gives you a chance to catch bad effects in the early stages when they still do not matter" J. Va'vra (Wire Aging Conference)

Detailed information regarding SY1527 mainframe and A1733 HV distribution boards can be found at CAEN web page.

The SMD HV is supplied by the CAEN SY1527 HV system. The mainframe is located in rack 2C5 (Second Floor, Third Row, near the center). The HV cables run from modules to the SMD crates (15 cables per each crate). At each crate HV cables re-grounded on patch panels assuring same ground for HV and signals to be read. From SMD crates, the HV lines then run to the SY1527 system. There are 10 HV cards, 12 HV channels each (model A1733) inside the mainframe to supply high voltages to the SMD chambers.

The parameters of the high voltage system controlled via Ethernet.

The GUI based on LabView and CAEN OPC server.

Hardware settings are:

Position of switches and status of LEDs on the front panel of SY1527 (from top to bottom, HV is Off)

Each A1733 card should have 50 Ohm Lemo 00 terminator to enable HV.

All SMD HV software is installed on EMCSC.STARP.BNL.GOV in folder C:/SY1527

The SMD HV Control provides one button operation of the HV system for the SMD. There are three main functions: Power On, Physics Mode, Power Off. There are two configuration files Conf.txt and Conf2.txt which defines ramp up speed and trip settings for different mode of operation. The nominal settings for Power On are (C:/SY1527/Conf.txt):

All channels are allowed to be ramp up in three consecutive attempts. If the first attempt (90 sec) for given channel lead to trip then ramp up speed will be set to 10 V/sec and second attempt (150 sec) will be performed. If second attempt will lead to trip then ramp up speed will be set to 7 V/sec and third attempt (300 sec) will be made. If all three attempt led to trip the program disconnect that particular channel from HV (corresponding led on main panel will turn in RED). In no later then 90 + 150 + 300 seconds program will change parameters of I0Set and Trip form 5 uA and 0.5 sec to 1.6 uA and 0.1 sec and will switch to the Physics Mode.

The nominal settings for Physics Mode are (C:/SY1527/Conf2.txt)

Channels allowed to trip no more then 6 times during the Physics Mode. If channel will trip then I0Set and Trip for that particular channel will be set to 5 uA and 0.5 sec and program will try to bring that channel up. On front panel Alarm Status will turn in RED, corresponded message will pop up in 'Current Mode' window, and corresponded to that channel LED will turn in YELLOW or RED. Once voltage reach 90% of nominal all indicators will turn to normal status. Usually it takes about 15 seconds to bring channel back to normal. At the bottom of the screen the right table with modules that tripped during the Physics Mode will be updated. If some channel will trip more than 6 times that channel will be HV disabled by the program and corresponded led will turn RED. The left table on the bottom of the screen will be updated. Such cases should be treated by experts only later on.

All SMD channels during the Physics Mode is under the monitoring. Each 3 seconds or so, the values of Voltage, Current and time are logged in files XX_YY_ZZ_P.txt in C:/SY1527/Log, where XX - current month, YY - current day, ZZ - current year, and P is V for Voltages and I for Currents. The current time saved in seconds. The macro C:/SY1527/smdhv.C plots bad channels history and fills histograms for all other channels.

Turn Off is trivial and no need explanations.

The meaning of the LED on main panel are:

It is important to monitor channels with high current (“Brown”), as well as channels that shows high number of trips during the operation.

Note: some channels (54 for example) probably has a leakage on external HV distribution board and believed to be OK in terms of discharges on anode wires as was verified during summer shutdown. The other might develop sparking during the run or might have intermittent problems (#8 for example). If problems with sparking will be detected at early stages then those channels might be cured by experts during the run, without of loss of entire chamber as it was happened during the first two years of operation.

The C:/SY1527/ReadSingleChannel.vi allows to monitor single channel. You may overwrite nominal parameters of HV for any channel using that program (it is not desired to do that). This program can run in parallel with the Main SMD HV Control program. The operation is trivial, specify 'Channel to monitor' and click on 'Update Channel'. If you wish to overwrite some parameters (see above) then fill properly VOSet etc. icons and click on Update Write. Important! Known bug. Before you start you better to fill all parameters, if you do not do that and stop the program later on the parameters will be overwritten with whatever it was in those windows, i.e. if V0Set was 0 then you will power Off the channel.

In some cases it is easy to monitor channels by looking at front panel of the SY1527 mainframe. The image of this panel can beobtained by opening telnet session (telnet 130.199.60.50 1527) on EMC01.STARP.BNL.GOV.

All three programs can run in parallel.

Experts to be called day or night no matter what

1. The operation crew lost communication with SY1527
2. Any accidental cases (large number (>5) of SMD channels suddenly disconnected from HV during the run)

For experts only!