[Paraview] Crash when extracting surface in a big mesh

[Edwards, Paul]

I think this int needs to be unsigned (or more bits).....

 

(gdb) frame 3 

#3  0x00002aaab2c053ea in vtkDataSetSurfaceFilter::NewFastGeomQuad
(this=0x14fe670, numPts=4)

    at
/tmp/padramgui-1.1/tmp/src/paraview/VTK/Graphics/vtkDataSetSurfaceFilter
.cxx:1730

1730        this->FastGeomQuadArrays[this->NextArrayIndex] 

 (gdb) list

1720            }

1721          }

1722        delete [] this->FastGeomQuadArrays;

1723        this->FastGeomQuadArrays = newArrays;

1724        this->NumberOfFastGeomQuadArrays = num;

1725        }

1726

1727      // Next: allocate a new array if necessary.

1728      if (this->FastGeomQuadArrays[this->NextArrayIndex] == NULL)

1729        {

1730        this->FastGeomQuadArrays[this->NextArrayIndex] 

1731          = new unsigned char[this->FastGeomQuadArrayLength];

1732        }

1733      

1734      vtkFastGeomQuad* q = reinterpret_cast<vtkFastGeomQuad*>

1735        (this->FastGeomQuadArrays[this->NextArrayIndex] +
this->NextQuadIndex);

1736      q->numPts = numPts;

1737

1738      this->NextQuadIndex += polySize;

1739

(gdb) print this->FastGeomQuadArrayLength

$2 = -1721647736

(gdb) whatis this->FastGeomQuadArrayLength 

type = int

(gdb)

 

More than just that variable needs to be updated though.

 

I experienced this when viewing the surface of a mesh with 90M cells on
a single machine.  Cuts worked without any problems.

 

Regards,

Paul


The data contained in, or attached to, this e-mail, may contain confidential information. If you have received it in error you should notify the sender immediately by reply e-mail, delete the message from your system and contact +44 (0) 1332 242424 (the Rolls-Royce IT Security Director) if you need assistance. Please do not copy it for any purpose, or disclose its contents to any other person.

An e-mail response to this address may be subject to interception or monitoring for operational reasons or for lawful business practices.

(c) 2008 Rolls-Royce plc

Registered office: 65 Buckingham Gate, London SW1E 6AT Company number: 1003142. Registered in England.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.paraview.org/pipermail/paraview/attachments/20081017/cbc8f4bc/attachment.htm>