<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<base href="x-msg://809/"><style><!--
/* Font Definitions */
@font-face
{font-family:"MS Mincho";
panose-1:2 2 6 9 4 2 5 8 3 4;}
@font-face
{font-family:"MS Mincho";
panose-1:2 2 6 9 4 2 5 8 3 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
@font-face
{font-family:Monaco;
panose-1:0 0 0 0 0 0 0 0 0 0;}
@font-face
{font-family:"\@MS Mincho";
panose-1:2 2 6 9 4 2 5 8 3 4;}
@font-face
{font-family:"Courier New\,courier";
panose-1:0 0 0 0 0 0 0 0 0 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
pre
{mso-style-priority:99;
mso-style-link:"HTML Preformatted Char";
margin:0in;
margin-bottom:.0001pt;
font-size:10.0pt;
font-family:"Courier New";}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0in;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";}
span.apple-converted-space
{mso-style-name:apple-converted-space;}
span.apple-tab-span
{mso-style-name:apple-tab-span;}
span.HTMLPreformattedChar
{mso-style-name:"HTML Preformatted Char";
mso-style-priority:99;
mso-style-link:"HTML Preformatted";
font-family:Consolas;}
span.apple-style-span
{mso-style-name:apple-style-span;}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";}
span.EmailStyle24
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Yep, I should have thought of that. You basically have a billion cells/8, or 125 million cells. You are basically throwing a large desktop computer at it
with 4 servers... I would probably be running something like 16 nodes (128 cores/processes) and see how it goes...<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Alan<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal" style="margin-left:.5in"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> Cook, Rich [mailto:cook47@llnl.gov]
<br>
<b>Sent:</b> Wednesday, October 30, 2013 6:03 PM<br>
<b>To:</b> Scott, W Alan<br>
<b>Cc:</b> paraview@paraview.org<br>
<b>Subject:</b> Re: [EXTERNAL] [Paraview] horrible slow performance -- I must be doing something very wrong<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal" style="margin-left:.5in"><o:p> </o:p></p>
<p class="MsoNormal" style="margin-left:.5in">I think I just wasn't throwing enough horsepower at it. I underestimated the rendering requirements of a 512^3 mesh. My bad. Adding more servers sped things up dramatically. Duh.
<o:p></o:p></p>
<div>
<p class="MsoNormal" style="margin-left:.5in"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal" style="margin-left:.5in">On Oct 30, 2013, at 3:33 PM, "Cook, Rich" <<a href="mailto:cook47@llnl.gov">cook47@llnl.gov</a>><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"> wrote:<o:p></o:p></p>
</div>
<p class="MsoNormal" style="margin-left:.5in"><br>
<br>
<o:p></o:p></p>
<div>
<p class="MsoNormal" style="margin-left:.5in"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal" style="margin-left:.5in">On Oct 29, 2013, at 5:45 PM, "Scott, W Alan" <<a href="mailto:wascott@sandia.gov">wascott@sandia.gov</a>> wrote:<o:p></o:p></p>
</div>
<p class="MsoNormal" style="margin-left:.5in"><br>
<br>
<o:p></o:p></p>
<div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Rich,</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">You are probably doing something wrong. :-) I assume you are using PV 4.0.1.</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">After setting up the local client/ remote server, using more than one server, try the following:</span><o:p></o:p></p>
</div>
<div style="margin-left:.5in">
<p class="MsoNormal" style="margin-left:.5in;text-indent:-.25in"><span style="font-size:11.0pt;font-family:Symbol;color:#1F497D">·</span><span style="font-size:7.0pt;color:#1F497D"> <span class="apple-converted-space"> </span></span><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Help/
About. Click on Connection Information. You should see the correct number of Processes (i.e., pvservers). Now you know you are running in parallel with MPI.</span><o:p></o:p></p>
</div>
</div>
<p class="MsoNormal" style="margin-left:.5in">Yep. <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><br>
<br>
<o:p></o:p></p>
<div>
<div style="margin-left:.5in">
<p class="MsoNormal" style="margin-left:.5in;text-indent:-.25in"><span style="font-size:11.0pt;font-family:Symbol;color:#1F497D">·</span><span style="font-size:7.0pt;color:#1F497D"> <span class="apple-converted-space"> </span></span><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Edit/
Settings/ Server. Change Remote Render Threshold to 0. You are now rendering remotely on the cluster. Make the ParaView window quite small. Tools/ Timer log. Clear. Close. Sources/ Sphere. Apply. Spin it. Tools/ Timer log. Is it fast enough?
On redsky, going through a disgusting number of layers from my ParaView client to my desktop (think X forwarding), I am getting 15 to 30 frames/second. Clear the timer log.</span><o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">0.054 sec/render == 18.5 FPS<o:p></o:p></p>
</div>
<div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><o:p> </o:p></p>
</div>
</div>
<p class="MsoNormal" style="margin-left:.5in"><br>
<br>
<o:p></o:p></p>
<div>
<div style="margin-left:.5in">
<p class="MsoNormal" style="margin-left:.5in;text-indent:-.25in"><span style="font-size:11.0pt;font-family:Symbol;color:#1F497D">·</span><span style="font-size:7.0pt;color:#1F497D"> <span class="apple-converted-space"> </span></span><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Make
ParaView full screen. Spin, spin. Timer log. I get about 10 frames/second interactive, 2 frames /second still. (This represents time with my finger on the mouse, time with finger off the mouse). This tells you how fast your network is pushing 2d images
from the server to the client. (As I said, for me, it is a SSLLOOWW pipe between me and my client.)</span><o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">About 4.5-5 FPS interactive, 3.5-5.0 still <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">I guess this means my network from our cluster to my desktop is crappy, I guess because of ssh tunnel? Tunnel is necessary due to topology. <o:p></o:p></p>
</div>
<p class="MsoNormal" style="margin-left:.5in"><br>
<br>
<o:p></o:p></p>
<div>
<div style="margin-left:.5in">
<p class="MsoNormal" style="margin-left:.5in;text-indent:-.25in"><span style="font-size:11.0pt;font-family:Symbol;color:#1F497D">·</span><span style="font-size:7.0pt;color:#1F497D"> <span class="apple-converted-space"> </span></span><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Make
ParaView small screened once again. Change the sphere’s Theta resolution to 1000 and Phi Resolution to 1000. You now have around 2 million cells. Spin, spin. Timer log. This represents the speed of the cluster, since we are having to render all of those
triangles (cells) (actually vertexes) in the Mesa3d software renderer.</span><o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-family:"Courier New,courier","serif"">Interactive Render, 0.229963 seconds</span><o:p></o:p></p>
</div>
<pre style="margin-left:.5in"><span style="font-family:"Courier New,courier","serif""> OpenGL Dev Render, 7e-05 seconds</span><o:p></o:p></pre>
<pre style="margin-left:.5in"><span style="font-family:"Courier New,courier","serif""> OpenGL Dev Render, 0.000525 seconds</span><o:p></o:p></pre>
<pre style="margin-left:.5in"><span style="font-family:"Courier New,courier","serif""> OpenGL Dev Render, 1.6e-05 seconds</span><o:p></o:p></pre>
<pre style="margin-left:.5in"><span style="font-family:"Courier New,courier","serif"">Interactive Render, 0.212467 seconds</span><o:p></o:p></pre>
<pre style="margin-left:.5in"><span style="font-family:"Courier New,courier","serif""> OpenGL Dev Render, 6.7e-05 seconds</span><o:p></o:p></pre>
<pre style="margin-left:.5in"><span style="font-family:"Courier New,courier","serif""> OpenGL Dev Render, 0.000532 seconds</span><o:p></o:p></pre>
<pre style="margin-left:.5in"><span style="font-family:"Courier New,courier","serif""> OpenGL Dev Render, 1.7e-05 seconds</span><o:p></o:p></pre>
<pre style="margin-left:.5in"><span style="font-family:"Courier New,courier","serif"">Still Render, 0.734462 seconds</span><o:p></o:p></pre>
<pre style="margin-left:.5in"><span style="font-family:"Courier New,courier","serif""> OpenGL Dev Render, 0.000118 seconds</span><o:p></o:p></pre>
<pre style="margin-left:.5in"><span style="font-family:"Courier New,courier","serif""> OpenGL Dev Render, 0.000521 seconds</span><o:p></o:p></pre>
<pre style="margin-left:.5in"><span style="font-family:"Courier New,courier","serif""> OpenGL Dev Render, 1.6e-05 seconds</span><o:p></o:p></pre>
<pre style="margin-left:.5in"><span style="font-family:"Courier New,courier","serif"">Still Render, 0.723525 seconds</span><o:p></o:p></pre>
<pre style="margin-left:.5in"><span style="font-family:"Courier New,courier","serif""><br><br><o:p></o:p></span></pre>
<div>
<p class="MsoNormal" style="margin-left:.5in"><o:p> </o:p></p>
</div>
<p class="MsoNormal" style="margin-left:.5in"><br>
<br>
<br>
<o:p></o:p></p>
<div>
<div style="margin-left:.5in">
<p class="MsoNormal" style="margin-left:.5in;text-indent:-.25in"><span style="font-size:11.0pt;font-family:Symbol;color:#1F497D">·</span><span style="font-size:7.0pt;color:#1F497D"> <span class="apple-converted-space"> </span></span><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Clear
the timer log. Delete the Sphere. View/ Memory Inspector. (This lets you know if you are overflowing memory. Further, you should have as many pvservers as you think you have. If you see one, you have an MPI issue.) Sources/ Wavelet. </span><o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">No memory problems. Expected number of servers. <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">Should I do something with the wavelet? <o:p></o:p></p>
</div>
<p class="MsoNormal" style="margin-left:.5in"><br>
<br>
<o:p></o:p></p>
<div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">By the way, if I were running the client locally (which I often do), I will get frame rates over 60/second connecting to the clusters.
Connecting to clusters across state lines will slow things down to 4 to 10 FPS or less.</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Huge, hero size data will also slow things down a lot.</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Another thing to try is use the Process Id Scalars filter. That will show you how your data is being spread around. It is very possible
that your data is being read through a serial reader, and only going into one process (server).</span><o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">I thought this would show the problem, but it looks like data is decomposed correctly. <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><o:p> </o:p></p>
</div>
<p class="MsoNormal" style="margin-left:.5in"><br>
<br>
<o:p></o:p></p>
<div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Don’t turn volume rendering on or opacity on (at first, anyway).</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">If that doesn’t help, I will be in tomorrow (and tonight for another hour) – if we need to chat.</span><o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><o:p> </o:p></p>
</div>
<p class="MsoNormal" style="margin-left:.5in">Would like that -- must still be missing something obvious… <br>
<br>
<o:p></o:p></p>
<div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Alan</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
</div>
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<div style="margin-left:.5in">
<p class="MsoNormal" style="margin-left:.5in"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span class="apple-converted-space"><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> </span></span><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""><a href="mailto:paraview-bounces@paraview.org"><span style="color:purple">paraview-bounces@paraview.org</span></a><span class="apple-converted-space"> </span>[mailto:paraview-<a href="mailto:bounces@paraview.org"><span style="color:purple">bounces@paraview.org</span></a>]<span class="apple-converted-space"> </span><b>On
Behalf Of<span class="apple-converted-space"> </span></b>Cook, Rich<br>
<b>Sent:</b><span class="apple-converted-space"> </span>Tuesday, October 29, 2013 6:16 PM<br>
<b>To:</b><span class="apple-converted-space"> </span><a href="mailto:paraview@paraview.org"><span style="color:purple">paraview@paraview.org</span></a><br>
<b>Subject:</b><span class="apple-converted-space"> </span>[EXTERNAL] [Paraview] horrible slow performance -- I must be doing something very wrong</span><o:p></o:p></p>
</div>
</div>
</div>
<div style="margin-left:.5in">
<p class="MsoNormal" style="margin-left:.5in"> <o:p></o:p></p>
</div>
<div style="margin-left:.5in">
<p class="MsoNormal" style="margin-left:.5in">Hello<o:p></o:p></p>
</div>
<div>
<div style="margin-left:.5in">
<p class="MsoNormal" style="margin-left:.5in">I am running paraview in client-server mode. I start the client on my desktop, run pvserver in parallel with four instances and connect my client to the "ringleader" pvserver through an ssh tunnel. The data is
a 512x512x512 rectilinear grid in Miranda format. <o:p></o:p></p>
</div>
</div>
<div>
<div style="margin-left:.5in">
<p class="MsoNormal" style="margin-left:.5in">I open my data and attempt to render a simple picture of my data and it is so slow I'm going to kill myself. Maybe one frame every 5 or 10 seconds. I'm imagining that the geometry is being shipped to my client,
and the client is doing the rendering, but I don't know that. <o:p></o:p></p>
</div>
</div>
<div>
<div style="margin-left:.5in">
<p class="MsoNormal" style="margin-left:.5in">Am I doing some basic thing wrong? How can I get reasonable performance?<o:p></o:p></p>
</div>
</div>
<div>
<div style="margin-left:.5in">
<p class="MsoNormal" style="margin-left:.5in">Thanks <o:p></o:p></p>
</div>
</div>
<div>
<div style="margin-left:.5in">
<p class="MsoNormal" style="margin-left:.5in"> <o:p></o:p></p>
</div>
<div>
<div>
<div style="margin-left:.5in">
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Monaco","serif"">-- </span><o:p></o:p></p>
</div>
</div>
<div>
<div style="margin-left:.5in">
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"MS Mincho"">✐</span><span style="font-size:10.0pt;font-family:"Monaco","serif"">Richard Cook</span><span style="font-size:10.0pt;font-family:"Courier New""> </span><span class="apple-converted-space"><span style="font-size:10.0pt;font-family:"Monaco","serif""> </span></span><span style="font-size:10.0pt;font-family:"Monaco","serif""> </span><o:p></o:p></p>
</div>
</div>
<div>
<div style="margin-left:.5in">
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"MS Mincho"">✇</span><span class="apple-converted-space"><span style="font-size:10.0pt;font-family:"Monaco","serif""> </span></span><span style="font-size:10.0pt;font-family:"Monaco","serif"">Lawrence
Livermore National Laboratory</span><o:p></o:p></p>
</div>
</div>
<div>
<div style="margin-left:.5in">
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Monaco","serif"">Bldg-453 Rm-4024, Mail Stop L-557 </span><o:p></o:p></p>
</div>
</div>
<div>
<div style="margin-left:.5in">
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Monaco","serif"">7000 East Avenue, Livermore, CA, 94550, USA</span><o:p></o:p></p>
</div>
</div>
<div>
<div style="margin-left:.5in">
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"MS Mincho"">☎</span><span class="apple-converted-space"><span style="font-size:10.0pt;font-family:"Monaco","serif""> </span></span><span style="font-size:10.0pt;font-family:"Monaco","serif"">(office)
(925) 423-9605 </span><o:p></o:p></p>
</div>
</div>
<div>
<div style="margin-left:.5in">
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"MS Mincho"">☎</span><span class="apple-converted-space"><span style="font-size:10.0pt;font-family:"Monaco","serif""> </span></span><span style="font-size:10.0pt;font-family:"Monaco","serif"">(fax)</span><span style="font-size:10.0pt;font-family:"Courier New""> </span><span style="font-size:10.0pt;font-family:"Monaco","serif"">(925)
423-6961</span><o:p></o:p></p>
</div>
</div>
<div>
<div style="margin-left:.5in">
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Monaco","serif"">---</span><o:p></o:p></p>
</div>
</div>
<div>
<div style="margin-left:.5in">
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Monaco","serif"">Information Management & Graphics Grp., Services & Development Div., Integrated Computing & Communications Dept.</span><o:p></o:p></p>
</div>
</div>
<div>
<div style="margin-left:.5in">
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Monaco","serif"">(opinions expressed herein are mine and not those of LLNL)</span><o:p></o:p></p>
</div>
</div>
<div style="margin-left:.5in">
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Monaco","serif""><br>
</span><span style="font-size:10.0pt"><br>
<br>
<br>
</span><o:p></o:p></p>
</div>
</div>
<div style="margin-left:.5in">
<p class="MsoNormal" style="margin-left:.5in"> <o:p></o:p></p>
</div>
</div>
</div>
</div>
<p class="MsoNormal" style="margin-left:.5in"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Monaco","serif"">-- <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"MS Mincho"">✐</span><span style="font-size:10.0pt;font-family:"Monaco","serif"">Richard Cook</span><span style="font-size:10.0pt;font-family:"Courier New""> </span><span style="font-size:10.0pt;font-family:"Monaco","serif"">
<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"MS Mincho"">✇</span><span style="font-size:10.0pt;font-family:"Monaco","serif""> Lawrence Livermore National Laboratory<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Monaco","serif"">Bldg-453 Rm-4024, Mail Stop L-557 <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Monaco","serif"">7000 East Avenue, Livermore, CA, 94550, USA<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"MS Mincho"">☎</span><span style="font-size:10.0pt;font-family:"Monaco","serif""> (office) (925) 423-9605 <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"MS Mincho"">☎</span><span style="font-size:10.0pt;font-family:"Monaco","serif""> (fax)</span><span style="font-size:10.0pt;font-family:"Courier New""> </span><span style="font-size:10.0pt;font-family:"Monaco","serif"">(925)
423-6961<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Monaco","serif"">---<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Monaco","serif"">Information Management & Graphics Grp., Services & Development Div., Integrated Computing & Communications Dept.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Monaco","serif"">(opinions expressed herein are mine and not those of LLNL)<o:p></o:p></span></p>
</div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Monaco","serif""><br>
</span><span style="font-size:10.0pt"><br>
<br>
</span><o:p></o:p></p>
</div>
<p class="MsoNormal" style="margin-left:.5in"><o:p> </o:p></p>
</div>
</div>
<p class="MsoNormal" style="margin-left:.5in"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Monaco","serif";color:black">-- <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"MS Mincho";color:black">✐</span><span style="font-size:10.0pt;font-family:"Monaco","serif";color:black">Richard Cook</span><span style="font-size:10.0pt;font-family:"Courier New";color:black"> </span><span style="font-size:10.0pt;font-family:"Monaco","serif";color:black">
<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"MS Mincho";color:black">✇</span><span style="font-size:10.0pt;font-family:"Monaco","serif";color:black"> Lawrence Livermore National Laboratory<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Monaco","serif";color:black">Bldg-453 Rm-4024, Mail Stop L-557 <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Monaco","serif";color:black">7000 East Avenue, Livermore, CA, 94550, USA<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"MS Mincho";color:black">☎</span><span style="font-size:10.0pt;font-family:"Monaco","serif";color:black"> (office) (925) 423-9605 <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"MS Mincho";color:black">☎</span><span style="font-size:10.0pt;font-family:"Monaco","serif";color:black"> (fax)</span><span style="font-size:10.0pt;font-family:"Courier New";color:black"> </span><span style="font-size:10.0pt;font-family:"Monaco","serif";color:black">(925)
423-6961<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Monaco","serif";color:black">---<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Monaco","serif";color:black">Information Management & Graphics Grp., Services & Development Div., Integrated Computing & Communications Dept.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Monaco","serif";color:black">(opinions expressed herein are mine and not those of LLNL)<o:p></o:p></span></p>
</div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Monaco","serif";color:black"><br>
<br>
<br>
</span><o:p></o:p></p>
</div>
<p class="MsoNormal" style="margin-left:.5in"><o:p> </o:p></p>
</div>
</div>
</body>
</html>