Skip to content
Snippets Groups Projects
Commit 02abd261 authored by d.bertini's avatar d.bertini
Browse files

New design using analyse steps 1 - reducing openpmd files to columnar parquet...

New design using analyse steps 1 - reducing openpmd files to columnar parquet files 2 - analysis from reduced sets to produce histograms + readme
parent 073862f2
No related branches found
No related tags found
No related merge requests found
......@@ -4,13 +4,13 @@
## Motivations
Realistic pic simulations, involving 3D grids or/and collisions for instance, produce usually large datasets that do not fit into memory on a single machine.
Realistic pic simulations, involving 3D grids or/and collisions for instance, produce usually large datasets that do not fit into memory on a single machine.
**pp-ana** uses parallel computing techniques to efficiently process arbitrary large datasets produced
by any [OpenPMD](https://github.com/openPMD/openPMD-standard) compatible PIC codes such as
[WarpX](https://github.com/ECP-WarpX/WarpX), [PiconGPU](https://github.com/ComputationalRadiationPhysics/picongpu), [fbic](https://github.com/fbpic/fbpic).
By leveraging [MPI(Message Passing Interface)](https://www.open-mpi.org/) and the [openpmd-api](https://openpmd-api.readthedocs.io/en/0.15.2/) library ,
**pp-ana** reads input datasets in chunks, which helps to mitigate memory limitations on a single node.
Furthermore **pp-ana** works perfectly on High-Performance Computing clusters, allowing for scalable and efficient data processing.
**pp-ana** reads input datasets in chunks, which helps to mitigate memory limitations on a single node.
Furthermore **pp-ana** works perfectly on High-Performance Computing clusters, allowing for scalable and efficient data processing.
## Overview
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment