dc.contributor.author |
Swanepoel, Derick
|
|
dc.contributor.author |
Van den Bergh, Frans
|
|
dc.date.accessioned |
2021-08-09T20:27:09Z |
|
dc.date.available |
2021-08-09T20:27:09Z |
|
dc.date.issued |
2017-03 |
|
dc.identifier.citation |
Swanepoel, D. & Van den Bergh, F. 2017. Multi-threaded compression of Earth observation time-series data. <i>International Journal of Digital Earth, 10(12).</i> http://hdl.handle.net/10204/12077 |
en_ZA |
dc.identifier.issn |
1753-8947 |
|
dc.identifier.uri |
http://dx.doi.org/10.1080/17538947.2017.1301580
|
|
dc.identifier.uri |
http://hdl.handle.net/10204/12077
|
|
dc.description.abstract |
Earth observation data are typically compressed using general-purpose single-threaded compression algorithms that operate at a fraction of the bandwidth of modern storage and processing systems. We present evidence that recently developed multi-threaded compression codecs offer substantial benefits over widely used single-threaded codecs in terms of compression efficiency when applied to a selection of moderate resolution imaging spectroradiometer (MODIS) datasets stored in the HDF5 format. Compression codecs from the LZ77 and Rice families are shown to vary in efficacy when applied to different MODIS data products, highlighting the need for compression strategies to be tailored to different classes of data. We also introduce LPC-Rice, a new multi-threaded codec, that performs particularly well when applied to time-series data. |
en_US |
dc.format |
Abstract |
en_US |
dc.language.iso |
en |
en_US |
dc.relation.uri |
http://www.tandfonline.com/doi/full/10.1080/17538947.2017.1301580 |
en_US |
dc.source |
International Journal of Digital Earth, 10(12) |
en_US |
dc.subject |
Data compression |
en_US |
dc.subject |
Multi-threading |
en_US |
dc.subject |
Time-series |
en_US |
dc.subject |
Hierarchical Data Format |
en_US |
dc.subject |
HDF |
en_US |
dc.subject |
HDF5 |
en_US |
dc.subject |
Moderate resolution imaging spectroradiometer |
en_US |
dc.subject |
MODIS |
en_US |
dc.title |
Multi-threaded compression of Earth observation time-series data |
en_US |
dc.type |
Article |
en_US |
dc.description.pages |
1753-8947 |
en_US |
dc.description.note |
© 2017 Informa UK Limited, trading as Taylor & Francis Group. Due to copyright restrictions, the attached PDF file only contains the abstract of the full text item. For access to the full text item, please consult the publisher's website: http://www.tandfonline.com/doi/full/10.1080/17538947.2017.1301580 |
en_US |
dc.description.cluster |
Meraka Institute |
en_US |
dc.description.impactarea |
Earth Observation Science and Information Technology |
en_US |
dc.identifier.apacitation |
Swanepoel, D., & Van den Bergh, F. (2017). Multi-threaded compression of Earth observation time-series data. <i>International Journal of Digital Earth, 10(12)</i>, http://hdl.handle.net/10204/12077 |
en_ZA |
dc.identifier.chicagocitation |
Swanepoel, Derick, and Frans Van den Bergh "Multi-threaded compression of Earth observation time-series data." <i>International Journal of Digital Earth, 10(12)</i> (2017) http://hdl.handle.net/10204/12077 |
en_ZA |
dc.identifier.vancouvercitation |
Swanepoel D, Van den Bergh F. Multi-threaded compression of Earth observation time-series data. International Journal of Digital Earth, 10(12). 2017; http://hdl.handle.net/10204/12077. |
en_ZA |
dc.identifier.ris |
TY - Article
AU - Swanepoel, Derick
AU - Van den Bergh, Frans
AB - Earth observation data are typically compressed using general-purpose single-threaded compression algorithms that operate at a fraction of the bandwidth of modern storage and processing systems. We present evidence that recently developed multi-threaded compression codecs offer substantial benefits over widely used single-threaded codecs in terms of compression efficiency when applied to a selection of moderate resolution imaging spectroradiometer (MODIS) datasets stored in the HDF5 format. Compression codecs from the LZ77 and Rice families are shown to vary in efficacy when applied to different MODIS data products, highlighting the need for compression strategies to be tailored to different classes of data. We also introduce LPC-Rice, a new multi-threaded codec, that performs particularly well when applied to time-series data.
DA - 2017-03
DB - ResearchSpace
DO - 10.1080/17538947.2017.1301580
DP - CSIR
J1 - International Journal of Digital Earth, 10(12)
KW - Data compression
KW - Multi-threading
KW - Time-series
KW - Hierarchical Data Format
KW - HDF
KW - HDF5
KW - Moderate resolution imaging spectroradiometer
KW - MODIS
LK - https://researchspace.csir.co.za
PY - 2017
SM - 1753-8947
T1 - Multi-threaded compression of Earth observation time-series data
TI - Multi-threaded compression of Earth observation time-series data
UR - http://hdl.handle.net/10204/12077
ER -
|
en_ZA |
dc.identifier.worklist |
19631 |
en_US |