The ESA Earth Observation Payload Data Ground Segment ...

EO payload data processing needs EO satellites dump payload data at typical rates between few Mbpsto more than 300Mbps (more than 500Mbps in the near future andmuch more in future with Ka-band) Big volume of archive data for reprocessing (L0), often in the orderof hundreds TB per reprocessing campaign Requirement is to speed more and more reprocessing time Data segmentation is normally the single satellite dump, i the orderof ~1-10 GB, much more in the future Additional need to auxiliary data for processing whose size is also issome cases not negligible (GB) Algorithms varies from very fast (few minutes per single segment)to “very slow” (many hours, up to 12) Processing algorithms are often not well parallelized/ parallelizable difficult to get advantage of high parallel processinginfrastructure like multi-core CPUs and GPUs Need anyway to implement a robust and performing infrastructureto parallelize multiple segments processing I/O main bottleneck