閱讀553 返回首頁    go iPhone_iPad_Mac_apple


HBase備份__開發人員指南_E-MapReduce-阿裏雲

E-MapReduce的HBase集群,可以通過HBase內置的快照(snapshot)功能對HBase的表進行備份,並將備份的數據導出到阿裏雲存儲服務OSS中,示例如下:

1.創建HBase集群

詳見集群創建文檔

2.創建table

  1. >create 'test','cf'

3.添加數據

  1. > put 'test','a','cf:c1',1
  2. > put 'test','a','cf:c2',2
  3. > put 'test','b','cf:c1',3
  4. > put 'test','b','cf:c2',4
  5. > put 'test','c','cf:c1',5
  6. > put 'test','c','cf:c2',6

4.創建快照

  1. hbase snapshot create -n test_snapshot -t test

查看快照

  1. >list_snapshots
  2. SNAPSHOT TABLE + CREATION TIME
  3. test_snapshot test (Sun Sep 04 20:31:00 +0800 2016)
  4. 1 row(s) in 0.2080 seconds

5. 導出到OSS

  1. hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -snapshot test_snapshot -copy-to oss://$accessKeyId:$accessKeySecret@$bucket.oss-cn-hangzhou-internal.aliyuncs.com/hbase/snapshot/test

備注: OSS使用內網Endpoint

6.創建另一個HBase集群

7.OSS導出快照

  1. hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -snapshot test_snapshot -copy-from oss://$accessKeyId:$accessKeySecret@$bucket.oss-cn-hangzhou-internal.aliyuncs.com/hbase/snapshot/test -copy-to /hbase/

8.從快照恢複數據

  1. >restore _snapshot 'test_snapshot'
  1. >scan 'test'
  2. ROW COLUMN+CELL
  3. a column=cf:c1, timestamp=1472992081375, value=1
  4. a column=cf:c2, timestamp=1472992090434, value=2
  5. b column=cf:c1, timestamp=1472992104339, value=3
  6. b column=cf:c2, timestamp=1472992099611, value=4
  7. c column=cf:c1, timestamp=1472992112657, value=5
  8. c column=cf:c2, timestamp=1472992118964, value=6
  9. 3 row(s) in 0.0540 seconds

9.從快照創建新表

  1. >clone_snapshot 'test_snapshot','test_2'
  1. >scan 'test_2'
  2. ROW COLUMN+CELL
  3. a column=cf:c1, timestamp=1472992081375, value=1
  4. a column=cf:c2, timestamp=1472992090434, value=2
  5. b column=cf:c1, timestamp=1472992104339, value=3
  6. b column=cf:c2, timestamp=1472992099611, value=4
  7. c column=cf:c1, timestamp=1472992112657, value=5
  8. c column=cf:c2, timestamp=1472992118964, value=6
  9. 3 row(s) in 0.0540 seconds

最後更新:2016-09-21 14:57:48

  上一篇:go 阿裏雲數據集成__數據傳輸軟件_開發人員指南_E-MapReduce-阿裏雲
  下一篇:go E-MapReduce SDK 發布說明__開發人員指南_E-MapReduce-阿裏雲