ParaView/ParaView Readers and Parallel Data Distribution: Difference between revisions

From KitwarePublic
Jump to navigationJump to search
(Created page with "<center>'''<font color="green">Under Development</font>'''</center> {| cellspacing="0" cellpadding="5" border="1" align="center" style="text-align:center;" | File Extension | ...")
 
No edit summary
 
(12 intermediate revisions by 2 users not shown)
Line 1: Line 1:
<center>'''<font color="green">Under Development</font>'''</center>
<center>'''<font color="green">Under Development. Editors, try to keep this list sorted by the extension </font>'''</center>
 


{| cellspacing="0" cellpadding="5" border="1"  align="center" style="text-align:center;"
{| cellspacing="0" cellpadding="5" border="1"  align="center" style="text-align:center;"
| File Extension  
| '''File Extension'''
| Format Description
| '''Format Description'''
| Reader
| '''Reader'''
| Parallelism
| '''Notes on Data Parallelism'''
| Time
| '''Time Support'''
|-
| *.ex2,.exo
| Exodus Files
| [http://paraview.org/OnlineHelpCurrent/ExodusReader.html ExodusIIReader]
|
This file format supports parallel distribution of data by splitting data across many files. It also supports mesh adaptation by splitting files at simulation times where adaptation occurs. Hence ParaView does the following:
 
The root node scans the directory for files in the set and reads metadata (blocks and variables defined on them) from a single file in the set. It then broadcasts this information to all processes. Each reads a different subset of files.
 
|
Time steps may be contained in a file as long as the mesh topology does not change. Time may also be split across a file series.
|-
| *.pvti
| Partitioned VTK XML Image Files
| [http://paraview.org/OnlineHelpCurrent/XMLPImageDataReader.html XMLPartitionedImageDataReader]
|
This is XML-based file format for saving ASCII or binary Image data (vtkImageData). The format consists of a meta-file that describes the dataset partitions and then separate .vti files for each partition. Similar to .vti files, when loading the file in parallel, the .pvti file is opened on all processes, to read the meta-data. Then the extents of the dataset are distributed among the processes in a load-balanced way. The reader uses vtkExtentSplitter to split the input extents into non-overlapping sub-extents minimizing files needed to be read for any sub-extent. Only those .vti files that contain the extents of the data corresponding to a particular process are opened and loaded on that process.
|
The file format support saving timesteps in the file, however, the more common mechanism is to use a file series.
|-
| *.pvts
| Partitioned VTK XML Structured Grid Files
| [http://paraview.org/OnlineHelpCurrent/XMLPStructuredGridReader.html XMLPStructuredGridReader]
|
This file format is similar to *.pvti, however used for saving vtkStructuredGrid aka. curvilinear grids. Refer to *.pvti description for details on parallelization.
|
The file format support saving timesteps in the file, however, the more common mechanism is to use a file series.
|-
| *.vti
| VTK XML Image Files
| [http://paraview.org/OnlineHelpCurrent/XMLImageDataReader.html XMLImageDataReader]
|
This file format does not support saving parallel distribution of data (refer to *.pvti file format for saving partitions). When loading the dataset in parallel, the structured extent of the dataset is distributed among all processes in a load-balanced way. All processes open the data file, however only the data corresponding to the subextent corresponding to the process are read in.
|
The file format support saving timesteps in the file, however, the more common mechanism is to use a file series.
|-
| *.vts
| VTK XML Structured Grid Files
| [http://paraview.org/OnlineHelpCurrent/XMLStructuredGridReader.html XMLStructuredGridReader]
|
This file format is similar to *.vti, however used for saving vtkStructuredGrid aka. curvilinear grids. Refer to *.vti description for details on parallelization.
|
The file format support saving timesteps in the file, however, the more common mechanism is to use a file series.
|-
|-
| *.vtk
| *.vtk
| Legacy VTK Files
| Legacy VTK Files
| [http://paraview.org/OnlineHelpCurrent/LegacyVTKFileReader.html Legacy VTK reader]
| [http://paraview.org/OnlineHelpCurrent/LegacyVTKFileReader.html LegacyVTKReader]
|
|
<notes on how this reader loads data in parallel>
This is the Legacy VTK file format, supporting binary or ASCII, for datasets of various types including structured and unstructured.
This file format, however, has no support for saving parallel distribution of data. Hence ParaView does the following:
----
'''Structured Data'''
----
For structured data, this reader reads the entire file on all processes and then '''crops''' the structured extents on each process so that for each process, the filters downstream process a block of  the structured data alone.
----
'''Unstructured Data'''
----
The root node reads the entire file and then the data is distributed  to all processes (using MPI) after an internal, fairly naive, partitioning algorithm (vtkTransmitUnstructuredGridPiece or vtkTransmitPolyDataPiece).
 
|
|
Time supported only as a file series.
Time supported only as a file series.
|-
|-
|}
|}

Latest revision as of 05:06, 8 March 2013

Under Development. Editors, try to keep this list sorted by the extension


File Extension Format Description Reader Notes on Data Parallelism Time Support
*.ex2,.exo Exodus Files ExodusIIReader

This file format supports parallel distribution of data by splitting data across many files. It also supports mesh adaptation by splitting files at simulation times where adaptation occurs. Hence ParaView does the following:

The root node scans the directory for files in the set and reads metadata (blocks and variables defined on them) from a single file in the set. It then broadcasts this information to all processes. Each reads a different subset of files.

Time steps may be contained in a file as long as the mesh topology does not change. Time may also be split across a file series.

*.pvti Partitioned VTK XML Image Files XMLPartitionedImageDataReader

This is XML-based file format for saving ASCII or binary Image data (vtkImageData). The format consists of a meta-file that describes the dataset partitions and then separate .vti files for each partition. Similar to .vti files, when loading the file in parallel, the .pvti file is opened on all processes, to read the meta-data. Then the extents of the dataset are distributed among the processes in a load-balanced way. The reader uses vtkExtentSplitter to split the input extents into non-overlapping sub-extents minimizing files needed to be read for any sub-extent. Only those .vti files that contain the extents of the data corresponding to a particular process are opened and loaded on that process.

The file format support saving timesteps in the file, however, the more common mechanism is to use a file series.

*.pvts Partitioned VTK XML Structured Grid Files XMLPStructuredGridReader

This file format is similar to *.pvti, however used for saving vtkStructuredGrid aka. curvilinear grids. Refer to *.pvti description for details on parallelization.

The file format support saving timesteps in the file, however, the more common mechanism is to use a file series.

*.vti VTK XML Image Files XMLImageDataReader

This file format does not support saving parallel distribution of data (refer to *.pvti file format for saving partitions). When loading the dataset in parallel, the structured extent of the dataset is distributed among all processes in a load-balanced way. All processes open the data file, however only the data corresponding to the subextent corresponding to the process are read in.

The file format support saving timesteps in the file, however, the more common mechanism is to use a file series.

*.vts VTK XML Structured Grid Files XMLStructuredGridReader

This file format is similar to *.vti, however used for saving vtkStructuredGrid aka. curvilinear grids. Refer to *.vti description for details on parallelization.

The file format support saving timesteps in the file, however, the more common mechanism is to use a file series.

*.vtk Legacy VTK Files LegacyVTKReader

This is the Legacy VTK file format, supporting binary or ASCII, for datasets of various types including structured and unstructured. This file format, however, has no support for saving parallel distribution of data. Hence ParaView does the following:


Structured Data


For structured data, this reader reads the entire file on all processes and then crops the structured extents on each process so that for each process, the filters downstream process a block of the structured data alone.


Unstructured Data


The root node reads the entire file and then the data is distributed to all processes (using MPI) after an internal, fairly naive, partitioning algorithm (vtkTransmitUnstructuredGridPiece or vtkTransmitPolyDataPiece).

Time supported only as a file series.