Some EPD QA


Figure 1: Number of "Type II" incidents per day total.  (2 bad boards in the same run # will count as 2 incidents.  An example of the ADC spectra is shown on the right.  The red histogram is all ADC, the blue is ADC with 300 < TAC < 4095.  This looks like a pedestal.


Figure 2: Number of incidents versus the EQ crate and Board #.  There were no issues in EQ2.  The board number scheme here is:
EQ1/EQ2
Board # (address)
1 (0x19)
2 (0x1A)
3 (0x1C)
4 (0x1D)
5 (0x1E)

EQ3
Board # (address)
1 (0x14)
2 (0x16)
3 (0x1C)
4 (0x1D)

We see that all of the incidents belong to 4 boards, EQ1 0x1C, EQ1 0x1D, EQ1 0x1E and EQ3 0x1C.  Looking at their daughter cards:


Figure 3: Incidents by daughter card for 4 problem boards.  DC1 = ch 0-3, DC2 = ch 8 - 11, DC3 = ch 16 - 19, DC4 = ch 24 - 27.

Total bad events = 1.7M+0.3M+5.6M+0.4M+3.9M + 8.4M + 3.0M+1.4M+0.9M+0.1M+0.3M = 26M

Chronological summary follows.

Day 092

19092032 - This is one where the EPD had very low statistics (but 4 M in the run!) no idea why.

Day 091

Bad Events = 53.43 K+ 92 K = 145.4 K

19091009 - Issue with WPP11TT2-5 (EQ3 Board 12 (0x1C) ch 16-19)
19091073 - Issue with WPP11TT2-5 (EQ3 Board 12 (0x1C) ch 16-19)

Day 090

Bad Events = 50.95 K

Run 19090006 - Issue with WPP11TT2-5 (EQ3 Board 12 (0x1C) ch 16-19)

Day 089

Bad Events = 3.7k + 43.1k = 46.8 K

Run 19089009 - Issue with WPP11TT2-5 (EQ3 Board 12 (0x1C) ch 16-19)
Run 19089012 - Issue with WPP11TT2-5 (EQ3 Board 12 (0x1C) ch 16-19)

Day 088
No issues ... though we weren't really running for a large fraction of the day

Day 087

No "type II" errors, but for:
Run 19088011 - looks like eq3 was out

Day 086

Bad Events = 145.37 K +759.58 K+109.15 K+77.95 K = 1.1M

Run 19086016 - Issue with WPP11TT2-5 (EQ3 Board 12 (0x1C) ch 16-19)
Run 19086038 - Issue with WPP11TT2-5 (EQ3 Board 12 (0x1C) ch 16-19)
Run 19086052 - Issue with WPP11TT2-5 (EQ3 Board 12 (0x1C) ch 16-19)
Run 19086075 - Issue with WPP11TT2-5 (EQ3 Board 12 (0x1C) ch 16-19)

Day 085

Bad Events = 331587

Run 19085038 - Issue with WPP10TT2-5 (EQ3 Board 12 (0x1C) ch  8-11)
Run 19085038 - Issue with WPP11TT2-5 (EQ3 Board 12 (0x1C) ch 16-19)

Day 084

Bad Events = 82111

Run 19084009 - Issue with WPP11TT2-5 (EQ3 Board 12 (0x1C) ch 16-19)

Day 083

Bad Events = 202619+682329+1356451+181082+62415 = 2.5M

Run 19083005 - Issue with WPP3TT2-5   (EQ1 Board 13 (0x1D) ch 16-19)
Run 19083019 - Issue with WPP11TT6-9 (EQ1 Board 12 (0x1C) ch 16-19)
Run 19083028 - Issue with WPP11TT2-5 (EQ3 Board 12 (0x1C) ch 16-19)
Run 19083050 - Issue with WPP8TT2-5   (EQ1 Board 12 (0x1E) ch 24-27)
Run 19083053 - Issue with WPP10TT2-5 (EQ3 Board 12 (0x1C) ch  8-11)

Day 082

Bad Events = 929507

Run 19082004 - Issue with WPP11TT2-5 (EQ3 Board 12 (0x1C) ch 16-19)

Day 081

Bad Events = 47048+95546+144421+1076619 = 1.4M

Run 19081001 - Issue with WPP11TT2-5 (EQ3 Board 12 (0x1C) ch 16-19)
Run 19081006 - Issue with WPP10TT2-5 (EQ3 Board 12 (0x1C) ch  8-11)
Run 19081006 - Issue with WPP11TT2-5 (EQ3 Board 12 (0x1C) ch 16-19)
Run 19081016 - Issue with WPP11TT6-9 (EQ1 Board 12 (0x1C) ch 16-19)
Run 19081023 - Issue with WPP8TT2-5   (EQ1 Board 12 (0x1E) ch 24-27)

Day 080
Bad events = 1738207+161059 + 1076619 = 3.0 M

This day had the reduced adc issue in WPP12TT2-5 (EQ3 Board 12 (0x1C) ch 24 - 27) - This problem was fixed as of 19080077.
Note: WPP11TT2-5 (EQ3 Board 12 (0x1C) ch 16 - 19) was also replaced.

Run 19080002 - Issue with WPP8TT2-5   (EQ1 Board 12 (0x1E) ch24-27)
Run 19080094 - Issue with WPP3TT2-5   (EQ1 Board 13 (0x1D) ch 16-19)
Run 19081023 - Issue with WPP8TT2-5   (EQ1 Board 12 (0x1E) ch24-27)

Day 079

Bad events = 1291046+4017039+1563324+580850+1003714 = 8.4 M :-(!!

This day had the reduced adc issue in WPP12TT2-5 (EQ3 Board 12 (0x1C) ch 24 - 27)

Run 19079024 - Issue with WPP11TT6-9 (EQ1 Board 12 (0x1C) ch 16-19)
Run 19079029 - Issue with WPP8TT2-5   (EQ1 Board 12 (0x1E) ch 24-27)
Run 19079032 - Issue with WPP11TT2-5 (EQ3 Board 12 (0x1C) ch 16-19)
Run 19079037 - Issue with WPP11TT2-5 (EQ3 Board 12 (0x1C) ch 16-19)
Run 19079049 - Issue with WPP3TT2-5   (EQ1 Board 13 (0x1D) ch 16-19)

Day 078

Bad events = 3888395+1

This day had the reduced adc issue in WPP12TT2-5 (EQ3 Board 12 (0x1C) ch 24 - 27)
This day had the reduced adc w/constant tac in EPP1-4TT1 (EQ3 Board 6 (0x16) Ch 0 - 4) - Problem fixed as of run 19078027

Run 19078008 - Issue with WPP11TT2-5 (EQ1 Board 12 (0x1C) ch 16-19)
Run 19078012 - Issue with WPP11TT2-5 (EQ1 Board 12 (0x1C) ch 16-19)

Day 077

Bad events = 102861+85420+256951 = 445k

This day had the reduced adc issue in WPP12TT2-5 (EQ3 Board 12 (0x1C) ch 24 - 27)
This day had the reduced adc w/constant tac in EPP1-4TT1 (EQ3 Board 6 (0x16) Ch 0 - 4)

Run 19077014 - Issue with WPP3TT2-5   (EQ1 Board 13 (0x1D) ch 16-19)
Run 19077015 - Issue with WPP10TT2-5 (EQ3 Board 12 (0x1C) ch 8-11)
Run 19077015 - Issue with WPP11TT2-5 (EQ3 Board 12 (0x1C) ch 16-19)
Run 19077050 - Issue with WPP11TT2-5 (EQ3 Board 12 (0x1C) ch 16-19)

Day 076

Bad events = 105618+536997+3976371+948299 = 5.6M  :-(!

This day had the reduced adc issue in WPP12TT2-5 (EQ3 Board 12 (0x1C) ch 24 - 27)
This day had the reduced adc w/constant tac in EPP1-4TT1 (EQ3 Board 6 (0x16) Ch 0 - 4)

Run 19076013 - Issue with WPP11TT2-5 (EQ3 Board 12 (0x1C) ch 16-19)
Run 19076013 - Issue with WPP11TT6-9 (EQ1 Board 12 (0x1C) ch 16-19)
Run 19076021 - Issue with WPP8TT2-5   (EQ1 Board 12 (0x1C) ch 24-27)
Run 19076032 - Issue with WPP8TT2-5   (EQ1 Board 12 (0x1C) ch 24-27)
Run 19076051 - Issue with WPP3TT2-5   (EQ1 Board 13 (0x1D) ch 16-19)

Day 075

Bad events = 345927

This day had the reduced adc issue in WPP12TT2-5 (EQ3 Board 12 (0x1C) ch 24 - 27)
This day had the reduced adc w/constant tac in EPP1-4TT1 (EQ3 Board 6 (0x16) Ch 0 - 4)

Run 19075056 - Issue with WPP11TT2-5 (EQ3 Board 12 (0x1C) ch 16-19)

Day 074

This day had the reduced adc issue in WPP12TT2-5 (EQ3 Board 12 (0x1C) ch 24 - 27)
This day had the reduced adc w/constant tac in EPP1-4TT1 (EQ3 Board 6 (0x16) Ch 0 - 4)

First physics is declared at 19074053.  ( I am excluding results from before this.)

Bad events = 266550+301831+1146187 = 1.7M

Run 19074061 - Issue with WPP11TT2-5 (EQ3 Board 12 (0x1C) ch 16-19)
Run 19074061 - Issue with WPP12TT2-5 (EQ3 Board 12 (0x1C) ch 24-27)
Run 19074098 - Issue with WPP11TT2-5 (EQ3 Board 12 (0x1C) ch 16-19)
Run 19074102 - Issue with WPP11TT2-5 (EQ3 Board 12 (0x1C) ch 16-19)