Parent Directory
| 
Revision Log
| 
Revision Graph
Update scripts
<html>
<head><title>ATLAS FullChainTest</title></head>
<body>
<TABLE BORDER=0 CELLSPACING=0 CELLPADDING=5><TR>
<TD><h2>ATLAS FullChainTest</h2>
<p><b>Author: <a href="http://cern.ch/Seth.Zenz">Seth Zenz</a></b> (Email: Seth dot Zenz at cern dot ch)
<p>Welcome to the results page for the automated ATLAS Full Chain Test. The purpose of the test is to rapidly find errors in the full production chain that occur every few events, so that the production system doesn't have to. It runs on the RTT queues at CERN for each completed nightly, and is started via a cron job that checks for new releases once per hour.
<P>Scroll down for details on the tests, see the links at right, or see <a href="doc/FCTresults.html">these instructions for how to get the FullChainTest results</a>.
<p><b>Status</b> <i>(Last update: 20 June)</i>
<ul>
<li>Ran on 12.0.7 (14 June): <a href="long/12.0.7/error_output/?C=M;O=D">ERROR</a> <a href="long/12.0.7/check_file/?C=M;O=D">checkFile</a> <a href="long/12.0.7/job_stats/?C=M;O=D">Stats</a>
<ul><li>all ok</li></ul></li>
<li>pcache settings updated, only limited set of jobs run</li>
<li>Web-accessible list of currently-running batch jobs (see link at right)</li>
</ul>
</TD><TD><img src="doc/Flowchart.jpg">
<p><TABLE BORDER=3 CELLPADDING=5 CELLSPACING=0><TR><TD><b>Links</b>
<ul>
<li>ERROR output: <a href="bugfix/error_output/?C=M;O=D">12.0.X</a> <b>13.0.X:</b> <a href="bugfix13/error_output/?C=M;O=D">bugfix</a> <a href="val/error_output/?C=M;O=D">val</a> <a href="pcache/error_output/?C=M;O=D">pcache</a></li>
<li>checkFile.py Output: <a href="bugfix/check_file/?C=M;O=D">12.0.X</a> <b>13.0.X:</b> <a href="bugfix13/check_file/?C=M;O=D">bugfix</a> <a href="val/check_file/?C=M;O=D">val</a> <a href="pcache/check_file/?C=M;O=D">pcache</a></li>
<li>Job CPU/memory statistics: <a href="bugfix/job_stats/?C=M;O=D">12.0.X</a> <b>13.0.X:</b> <a href="bugfix13/job_stats/?C=M;O=D">bugfix</a> <a href="val/job_stats/?C=M;O=D">val</a> <a href="pcache/job_stats/?C=M;O=D">pcache</a></li>
<li>Last good root file from each stage: <a href="bugfix/last_good_root">12.0.X</a> <a href="12.0.6.5/root_files">12.0.6.5</a></li>
<li>Directories where transforms were run: <a href="bugfix/full_output/?C=M;O=D">12.0.X</a> (<a href="long/bugfix/full_output/?C=M;O=D">long</a>) <b>13.0.X:</b> <a href="bugfix13/full_output/?C=M;O=D">bugfix</a> (<a href="long/bugfix13/full_output/?C=M;O=D">long</a>) <a href="val/full_output/?C=M;O=D">val</a> (<a href="long/val/full_output/?C=M;O=D">long</a>) <a href="pcache/full_output/?C=M;O=D">pcache</a> (<a href="long/pcache/full_output/?C=M;O=D">long</a>)
<ul><li>From here, navigate to individual run directories labelled by date, release and job type, and original log files can be found</li></ul></li>
<li>Currently running jobs: <a href="cron/currentjobs_bugfix.txt">12.0.X</a> <b>13.0.X:</b> <a href="cron/currentjobs_bugfix13.txt">bugfix</a> <a href="cron/currentjobs_val.txt">val</a> <a href="cron/currentjobs_pcache.txt">pcache</a></li>
<li><a href="cron/space_log.txt">Space use log</a> (scroll to bottom)
<li>AFS access
<ul>
<li>/afs/cern.ch/atlas/offline/external/FullChainTest</li>
<li>Links to last good root file - /{branch}/last_good_root</li>
<li>Run directories - /{branch}/full_output</li>
</ul></li>
<li><a href="http://atlas-sw.cern.ch/cgi-bin/viewcvs-atlas.cgi/groups/FullChainTest/">Scripts in CVS</a></li>
</ul> </TD></TR></TABLE>
</TD</TR></TABLE>
<b>Talks</b>
<ul>
<li><a href="doc/Zenz-Validation-FullChainTest-27Feb2007.pdf">27 February 2007</a></li>
<li><a href="doc/Zenz-LBLSoftware-FullChainTest-13Mar2007.pdf">13 March 2007</a></li>
</ul>
<b>Details</b>
<p>The test does the following:
<ul>
<li>Automatically checks stamp link once per hour to see if it has changed, and starts jobs if so.
<ul>
<li>Release 12 bugfix - /afs/cern.ch/atlas/software/builds/nightlies/12.0.X/AtlasProduction/latest_copied_releaseBF32BS3ProdOpt</li>
<li>Release 13 bugfix - /afs/cern.ch/atlas/software/builds/nightlies/bugfix/AtlasProduction/latest_copied_releaseBF32BS4ProdOpt</li>
<li>Release 13 val - /afs/cern.ch/atlas/software/builds/nightlies/val/AtlasProduction/latest_copied_releaseVAL32BS4ProdOpt</li>
<li>Release 13 pcache - /afs/cern.ch/atlas/software/builds/nightlies/pcache/AtlasProduction/latest_copied_release13010Y32BS3ProdOpt</li>
</ul></li>
<li>Detailed list of jobs as of 9 May: <a href="doc/FullChainTestJobList-09May2007.xls">Excel format</a>
<li>Summary of jobs:
<ul><li>DC3.005200.T1_McAtNlo_Jimmy - 5000 events generated, 50 events simulated/digitized</li>
<li>DC3.005300.PythiaH130zz4l - 5000 events generated, 50 events simulated/digitized</li>
<li>DC3.006384.PythiaH120gamgam - 5000 events generated, 50 events simulated/digitized</li>
<li>DC3.005188.A3_Ztautau_filter - 5000 events generated, 50 events simulated/digitized</li>
<li>Atlfast on 5000 ttbar events</li>
<li>RecoAll - basic reconstruction of the output from all of the above in one job (200 events)
<ul><li>ESD, AOD, TAG</li></ul></li>
<li>BackRecoAll - same as RecoAll, but reconstructs using older release (currently 12.0.6.5)</li>
<li>BackTagAll - same as BackRecoAll, but for tag building
<li>LongRecoAll - same as RecoAll, but adds <a href="rec_input">an additional 800 ttbar events from 12.0.31 RDO's</a><ul>
<li>Total of 1000 events</li>
<li>To be replaced by equivalent RTT job and removed</li>
</ul></li>
<li>RecoNoTruth - Runs on RDO from streaming test, 15 events</li>
<ul><li>ESD, AOD, TAG</li></ul></li>
<li>PileupDigi - Digitize, with pileup, hits from DC3.005200.T1_McAtNlo_Jimmy (50 events)
<ul>
<li>Uses luminosity of 1*10^33, cavern background 5x nominal (since 10 May, 10x before that)
<li><a href="pileup_input">Input files for cavern background and min bias</a></li>
</ul></li>
<li>PileupReco using pileup digi output
<ul><li>ESD, AOD, TAG</li></ul></li>
<li>Tag Merge - runs TAG building on two AOD's to make sure the merging works</li>
</ul></li>
<li>If any step in production fails, use the last good version of the output for the next step.</li>
<li>Make the "last good version" for each step publicly available.</li>
<li>Post-processing
<ul>
<li>ERROR file
<ul>
<li>First lists job transform summary, including all un-ignored ERRORs</li>
<li>Next lists all ERRORs in context</li>
</ul></li>
<li>Output from checkFile.py available for all ESD and AOD files produced</li>
<li>CPU/memory statistics</li>
</ul></li>
<li>Key results are accessible from this website, and the entire directory can be browed on afs:
<ul><li>/afs/cern.ch/atlas/offline/external/FullChainTest</li></ul></li>
</ul>
<p><b>In progress</b>
<ul>
<li><a href="doc">Documentation</a></li>
</ul>
<b>To be added</b>
<ul>
<li>List selected warnings</li>
<li>More systematic status reporting</li>
</ul>
<body></html>
| CERN Central CVS service | ViewVC Help |
| Powered by ViewVC 1.0.9 |