TPC QA RUN 2025

 This is a page for TPC QA showing progress, failure rates and discussing issues for TPCs that may show up during the run.
There has been similar pages for many of the earlier runs.

7/3/25
Analyzed runs up to day 184 (today)

bad RDO numbers
 161012 -  162033 # bad RDO 4
 166003 -  166022 # bad RDO 1
 166024 -  166024 # bad RDO 2
 166028 -  166028 # bad RDO 1
 166029 -  167008 # bad RDO 2
 167011 -  167011 # bad RDO 3
 167020 -  168014 # bad RDO 1
 168015 -  168020 # bad RDO 2
 168032 -  171028 # bad RDO 1
 171032 -  171032 # bad RDO 5
 171045 -  171045 # bad RDO 4
 171064 -  172004 # bad RDO 2
 172018 -  173069 # bad RDO 3
 173070 -  174066 # bad RDO 4
 175025 -  175040 # bad RDO 3
 176043 -  177013 # bad RDO 6
 177017 -  177019 # bad RDO 7
 177020 -  177020 # bad RDO 6
 177025 -  178014 # bad RDO 7
 178024 -  178024 # bad RDO 4
 178027 -  178032 # bad RDO 5
 178037 -  178042 # bad RDO 4
 178043 -  178044 # bad RDO 5
 178057 -  180014 # bad RDO 3
 180022 -  181013 # bad RDO 4
 181019 -  181029 # bad RDO 5
 181036 -  181043 # bad RDO 4
 181048 -  181064 # bad RDO 5
 181071 -  182028 # bad RDO 6
 182032 -  183023 # bad RDO 7
 184007 -  184007 # bad RDO 2
 184009 -  184009 # bad RDO 3
 

Bad FEE numbers analkysis with change runnumbers
     0 -  161009 #bad FEE 71
 161012 -  162033 #bad FEE 86
 166003 -  166022 #bad FEE 52
 166024 -  166024 #bad FEE 67
 166028 -  166028 #bad FEE 52
 166029 -  167008 #bad FEE 67
 167011 -  167011 #bad FEE 82
 167020 -  168014 #bad FEE 54
 168015 -  168020 #bad FEE 68
 168032 -  171028 #bad FEE 54
 171032 -  171032 #bad FEE 89
 171045 -  172004 #bad FEE 80
 172018 -  173069 #bad FEE 95
 173070 -  174066 #bad FEE 102
 175025 -  175040 #bad FEE 95
 176043 -  177013 #bad FEE 127
 177017 -  177019 #bad FEE 137
 177020 -  177020 #bad FEE 127
 177025 -  178014 #bad FEE 137
 178024 -  178024 #bad FEE 86
 178027 -  178032 #bad FEE 96
 178037 -  178039 #bad FEE 88
 178040 -  178042 #bad FEE 89
 178043 -  178044 #bad FEE 102
 178057 -  180014 #bad FEE 74
 180022 -  181013 #bad FEE 88
 181019 -  181029 #bad FEE 102
 181036 -  181043 #bad FEE 88
 181048 -  181064 #bad FEE 98
 181071 -  182028 #bad FEE 112
 182032 -  182054 #bad Fee 128

First QA plot from 6/17/25

The histograms analyzed daily by fast offline, and file is avalable in videbaks/run25/
able typically 4-6 hours after data are taken.




Runs 26184022-28 were plagued with TPC Anode HV trips, particularly (Sector 4, Channel 5) and (Sector 20, Channel 5). Also faced several iTPC RDO trips, particularly (Sector 13, RDO 3). These runs are marked as bad. 

Set HV for TPC (Sector 4, Channel 5) to 1345V, masked out iTPC (Sector 13, RDO 30 on Tonko's advice. Alexei increased  (Sector 20, Channel 5)'s trip level from 2uA to 4uA. There has been no trips since.



Copy of Tonko's log (google doc)
  • Jul 2

    • iS07-4 image 0

    • IS02-4 image 0

    • iS15-3 image 0

    • iS10-4 flaky at I1

      • reburned, just in case

  • Jul 1

    • iS22-4 masked in high rate running because it was giving us issues

      • take a better look in the logs at e.g. run 26182028, 29

      • PROM?

        • reburned just in case but still issues? Probably power, damn.

      • yes, power, voltage is 3.2V on input which is at the very edge

      • perhaps kill a few FEEs???

      • stays masked

  • Jun 30

    • iS05-1 masked (PROM?)

      • hm, looked OK but reburning just in case…

      • reburned, try

      • should unmask after the test

    • IS21-2 masked

      • FEE PROM?

      • reburned, try

      • should unmask after the test

    • iS06-2 masked – PROM?

      • yes, reburned

      • should unmask

    • iS04-2 failed prom-check but I need more time

      • reburned

    • iS22-3 failed prom-check, ibid

      • reburned

  • Jun 29

    • iS13-2 masked – PROM?

      • yes, but the master image? But then it recovers??

      • will stay masked until I get more time…

      • reburned image 0 and 1

      • should unmask after the test

  • Jun 28

    • iS11-2 auto-recovers a lot, from day 1

      • generally flaky FEE connection, on most FEEs

  • Jun 27

    • iS03-3-FEE#2 first 32 channels (1 SAMPA) look noisy

      • monitor it…

      • masked FEE

    • iS02-2 – PROM

      • reburned – looks OK

      • should unmask

    • iS03-1

      • configures but I need to see it running

      • bad in running; FEE #6 masked so let’s see; lppks OK

    • iS03-3

      • configures but I need to see it running

      • bad in running; FEE #10 masked so let’s see; looks OK

    • iS04-1 flaky since day 1

      • configures but this is the problematic RDO with likely power issues

      • stays masked?

      • bad while running; but OK with empty events

      • unmask for a test

    • 1S10-3 masked; suspect PROM

      • yup, PROM – reburning…

      • unmasked

    • iS17-4 – nasty, no FEEs respond – power? a2?

      • PROM

      • reburned – should unmask

    • iS18-1 – looks like power but I need to check more

      • no FEEs succeed for many attempts but sometimes they do??

      • reburned I1 and I2 PROM and now looks OK

      • should unmask

      • nope, bad again

      • on 2nd look: many FEEs don’t boot… but not all, and they change so some power issue?

      • looks OK again, unmask

    • iS19-2 – no FEEs respond – power? a2?

      • PROM

      • reburned – should unmask

    • iS24-4 OLD; stays masked

      • also has bad tokens and trg_cmd so mask it forever

        Jun 16

          • iS05-3 masked

            • FEE #1 masked

            • RDO unmasked

              Jun 15 (AuAu 4kHz rate)

          • TPX S01-4 masked

            • there seem to be 2 iffy FEEs, even from last year – masked them

            • let’s unmask the RDO

          • iS09-3 masked

            • flaky. Looks like FEE #6. But keep masked until I get time.

            • should unmask RDO at re-test

          • Flaky

            • iS01-4 known

            • iS05-3 known

            • iS11-2 known

            • iS21-6

            • iS12-6

            • iS10-4 known