User Tools

Site Tools


progetti:icarus:production-guide

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
progetti:icarus:production-guide [2025/10/24 12:43] – [Initial Setup] vpia@infn.itprogetti:icarus:production-guide [2025/10/27 15:24] (current) – [Submit the batch of jobs] vpia@infn.it
Line 65: Line 65:
  
 ===== Configure the next job submission ===== ===== Configure the next job submission =====
-If the current number of //pending// jobs is smaller than **300**, a new batch of jobs can be submitted. First the shifter has to configure the job submission. To do so, the shifter has to go to the ''prod-scripts'' folder inside the working area created in the intial setup section (i.e ''cd /storage/gpfs_data/icarus/local/prod/<selected-tag>/prod-scripts''). Example:+If the current number of //pending// jobs is smaller than **300**, a new batch of jobs can be submitted. First the shifter has to configure the job submission. To do so, the shifter has to go to the ''prod-scripts'' folder inside the working area created in the intial setup section. Example:
  
-  cd /storage/gpfs_data/icarus/local/prod/run2-v09_72_00_06-122023-variables/prod-scripts+  cd /storage/gpfs_data/icarus/local/users/vpia/productions/run2-v09_72_00_06-122023-variables/prod-scripts
  
 Then, the shifter has to configure the job submission editing and modifing the ''variable.sh'' file. This step is different based on the production type, [[https://wiki.infn.it/progetti/icarus/production-guide#configure_the_job_submission_for_real_data_production|real]] or [[https://wiki.infn.it/progetti/icarus/production-guide#configure_the_job_submission_for_mc_data_production|mc]] data. Then, the shifter has to configure the job submission editing and modifing the ''variable.sh'' file. This step is different based on the production type, [[https://wiki.infn.it/progetti/icarus/production-guide#configure_the_job_submission_for_real_data_production|real]] or [[https://wiki.infn.it/progetti/icarus/production-guide#configure_the_job_submission_for_mc_data_production|mc]] data.
Line 141: Line 141:
  
 The script will automatically submit all the needed jobs. This could take a few minutes during which the shell will look unresponsive (it is not). The script will automatically submit all the needed jobs. This could take a few minutes during which the shell will look unresponsive (it is not).
 +
 +After regaining control of the shell, you can check if the jobs were correctly submitted by either check the same grafana page shown previously (it updates with a **4-5 minutes delay** so you'll not be able to see the new jobs immediatly) or by running the **condor_q** command:
 +
 +  $ condor_q
 +  
 +  Schedd: sn01-htc.cr.cnaf.infn.it : <131.154.192.242:9618?... @ 10/27/25 16:17:10
 +  OWNER    BATCH_NAME           SUBMITTED   DONE   RUN    IDLE  TOTAL JOB_IDS
 +  valerpia ID: 11228736       10/23 05:30    238      _      _    356 11228736.0-352
 +  valerpia ID: 11228746       10/23 05:31    157      _      _    264 11228746.4-253
 +  valerpia 11854_BNBMAJORITY  10/24 21:00      _      _      _     12 11391004.0-11
 +  valerpia 11854_BNBMINBIAS   10/24 21:00      _      _      _     12 11391005.0-11
 +  valerpia 11873_BNBMAJORITY  10/26 05:03      2      _      _    767 11441545.0-766
 +  valerpia 11873_BNBMINBIAS   10/26 05:05      1    127      _    559 11441546.0-558
 +  
 +  Total for query: 1572 jobs; 1445 completed, 0 removed, 0 idle, 127 running, 0 held, 0 suspended 
 +  Total for valerpia: 1572 jobs; 1445 completed, 0 removed, 0 idle, 127 running, 0 held, 0 suspended 
 +  Total for all users: 89517 jobs; 60905 completed, 0 removed, 18666 idle, 9666 running, 280 held, 0 suspended
 +
 +The new jobs should be at the bottom of the list, either in the RUN or IDLE stage.
  
 If the run list was provided with a Google Sheet document, update the **Submitted column** to **yes**. If the run list was provided with a Google Sheet document, update the **Submitted column** to **yes**.
progetti/icarus/production-guide.1761309807.txt.gz · Last modified: 2025/10/24 12:43 by vpia@infn.it

Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki