Outline of High Speed Ingestion with Data Partitioning in Content ...
Outline of High Speed Ingestion with Data Partitioning in Content ... Outline of High Speed Ingestion with Data Partitioning in Content ...
© Copyright 2007 EMC Corporation. All rights reserved.26Other notes for partition exchange• Indexes associated with partitioned tables will be ‘local’indexes• Content server will generate scripts to exchange a partitionwith some in an offline tables– Apply method determines the tables involved and generates a script• The content must be shutdown before (and during) theexecution of the scripts• Note: dmi_object_type should be ranged partitioned tosupport this (currently not done by default)– A new getObjectWithOptions() method will be provided to allow thecaller to supply the object type and partition id in order to makefetch inexpensive– Otherwise a fetch will require a local index lookup per partition
© Copyright 2007 EMC Corporation. All rights reserved.27Best Use-cases for partitions• Ingest of legacy data for online system• Massive ingest of few input streams in short load window• Mass drop of partition aligned data
- Page 4 and 5: © Copyright 2007 EMC Corporation.
- Page 6 and 7: © Copyright 2007 EMC Corporation.
- Page 8 and 9: © Copyright 2007 EMC Corporation.
- Page 10 and 11: © Copyright 2007 EMC Corporation.
- Page 12 and 13: © Copyright 2007 EMC Corporation.
- Page 14 and 15: © Copyright 2007 EMC Corporation.
- Page 16 and 17: © Copyright 2007 EMC Corporation.
- Page 18 and 19: © Copyright 2007 EMC Corporation.
- Page 20 and 21: © Copyright 2007 EMC Corporation.
- Page 22 and 23: © Copyright 2007 EMC Corporation.
- Page 24 and 25: Partition ExchangeDmr_content_rDmr_
© Copyright 2007 EMC Corporation. All rights reserved.26Other notes for partition exchange• Indexes associated <strong>with</strong> partitioned tables will be ‘local’<strong>in</strong>dexes• <strong>Content</strong> server will generate scripts to exchange a partition<strong>with</strong> some <strong>in</strong> an <strong>of</strong>fl<strong>in</strong>e tables– Apply method determ<strong>in</strong>es the tables <strong>in</strong>volved and generates a script• The content must be shutdown before (and dur<strong>in</strong>g) theexecution <strong>of</strong> the scripts• Note: dmi_object_type should be ranged partitioned tosupport this (currently not done by default)– A new getObjectWithOptions() method will be provided to allow thecaller to supply the object type and partition id <strong>in</strong> order to makefetch <strong>in</strong>expensive– Otherwise a fetch will require a local <strong>in</strong>dex lookup per partition
Change language